THE  RELATIONSHIP  OF  SELF-PACED  INDIVIDUALIZED  INSTRUCTION 
TO  PUPIL  ACHIEVEMENT  WHEN  MEASURED  BY  POOLING  THE 
PROBABILITIES  OF  SEVERAL  INDEPENDENT  SAMPLES 


By 


PAUL  IVAN  JOHNSON 


A  DISSERTATION  PRESENTED  TO  THE  GRADUATE  COUNCIL  OF 

THE  UNI  VERS  I TY  OF  FLORI DA 

IN  PARTIAL  FULFILLMENT  OF  THE  REQUIREMENTS  FOR  THE 

DEGREE  OF  DOCTOR  OF  PHILOSOPHY 


UNIVERSITY  OF  FLORIDA 
1979 


ACKNOWLEDGMENTS 


Grateful  acknowledgment  is  made  to  the  many  indi- 
viduals who  made  this  study  possible.   Sincere  appreciation 
is  extended  to  Dr.  Ralph  B.  Kimbrough  (chairman),  Dr.  Robert 
S.  Soar,  Dr.  Michael  Y.  Nunnery,  Dr.  Herbert  Franklin,  and 
Dr.  Paul  S.  George  who  made  many  valuable  suggestions  as 
members  of  the  dissertation  committee. 

To  Dr.  Ralph  B.  Kimbrough,  Dr.  Robert  S.  Soar,  and 
Dr.  Michael  Y.  Nunnery  the  writer  owes  a  special  debt  of 
gratitude  for  their  advice  which  was  always  clear  and 
directly  to  the  point. 

Finally,  the  writer  would  like  to  acknowledge  -his 
indebtedness  to  his  wife,  Dona,  without  whose  understanding, 
encouragement,  and  inspiration,  this  dissertation  probably 
would  not  have  been  completed. 


TABLE  OF  CONTENTS 


Page 


ACKNOWLEDGMENTS    

ABSTRACT    

CHAPTER 

I.   INTRODUCTION    

Need  for  the  Study    

Statement  of  the  Problem    

Delimitations  and  Limitations    .... 

Definition  of  Terms    

Procedures    

Organization  of  the  Study  by 

Chapters    

II.   SELECTING  A  SET  OF  STUDIES    

Introduction    

Miller's  Review    

Hirsch's  Review    

Schoen's  Review    

Summary    

Ml.   REPORTED  RESULTS  OF  THE  INDIVIDUAL 

STUDIES  AND  CONVERSION  TO  CHl-SOUARE 

Introduction    

Bull  (1 971  )    

Englert  (1 972)    


15 
15 
17 
20 

26 
28 
28 
28 
29 
29 
33 

35 
35 
37 
38 


TABLE  OF  CONTENTS  (con't) 

CHAPTER 

III.     Fi  sher  ( 1973)    

Hanneman  (1971)    

Herceg  ( 1 972)    

Hi  rsch  (I  972)    

Ludeman  (1973)    

Penner  (  1 972)    

Schoen  and  Todd  (197^)-   

Taylor  (1971)    

Thomas  (1 971  )    

Summary    

IV.   SUMMARY,  CONCLUSIONS,  IMPLICATIONS  AND 
SUGGESTIONS  FOR  FURTHER  RESEARCH  ,. 

Summary    

Conclusions    

Implications    

Suggestions  for  Further  Research  .. 

APPENDIX    HISTORY  OF  AGGREGATE  CHI-SQUARE  AND 
TRANSFORMATION   PROCEDURES    

REFERENCE  NOTES    

REFERENCES    

BIOGRAPHICAL  SKETCH    


Page 

k] 

h3 

h5 

hi 

50 

52 

Sh 

57 

58 

61 

63 

63 

65 

65 

67 

70 

72 

73 

77 

Abstract  of  Dissertation  Presented  to  the  Graduate  Council 

of  the  University  of  Florida  in  Partial  Fulfillment  of  the 

Requirements  for  the  Degree  of  Doctor  of  Philosophy 


THE  RELATIONSHIP  OF  SELF-PACED  INDIVIDUALIZED  INSTRUCTION 
TO  PUPIL  ACHIEVEMENT  WHEN  MEASURED  BY  POOLING  THE 
PROBABILITIES  OF  SEVERAL  INDEPENDENT  SAMPLES 

By 

Paul  Ivan  Johnson 

June  1979 

Chariman:   Dr.  Ralph  B.  Kimbrough 

Major  Department:   Educational  Administration  6  Supervision 

The  problem  of  inconsistent  results  in  educational 
research  has  been  pervasive  in  the  education  profession. 
Administrators  and  other  educational  decision  makers  have, 
under  the  pressure  of  economic,  political,  and  social  forces, 
often  been  pressured  to  adopt  educational  innovations  with- 
out prior  validation  through  empirical  research.   Self-paced 
individualized  instruction  was  an  example  of  an  instructional 
innovation  which  has  been  widely  adopted  by  school  decision 
makers  without  such  validation.   Research  results  reported 
on  self-paced  individualized  instruction  have  presented  an 
inconsistent  and  inconclusive  data  base  from  which  to  for- 
mulate an  objective  decision. 

Some  researchers  have  reported  that  self-paced  individ- 
ualized instruction  is  superior  to  traditional  classroom 
instructional  practices.   Other  researchers  have  reported 


the  opposite  result  and  yet  others  have  reported  "no 
difference"  in  the  two  methodologies  when  those  method- 
ologies were  comapred  by  their  effect  on  student  achievement 
The  concept  of  secondary  analysis  promised  a  solution  to 
the  problem  of  inconsistent  results  thereby  making  it 
possible  for  decision  makers  to  base  their  decisions  on 
reliable  research.   In  secondary  analysis,  the  researcher 
gathers  data  from  previously  completed  research  studies. 
The  researcher  reorganizes  and  reanalyzes  the  data  through 
a  variety  of  possible  techniques. 

In  this  study,  the  aggregate  chi-square  statistical 
procedure  was  applied  to  the  reported  results  of  a  pre- 
selected set  of  independent  studies.   By  pooling  the  sta- 
tistical results  of  2k     independent  samples  taken  from  11 
independent  research  studies,  it  was  shown  that  traditional 
classroom  practices  are  superior  to  self-paced  individual- 
ized instruction  when  pupil  achievement  is  used  as  the 
criterion.   The  derived  statistic  was  aggregate  x^  (^8)= 
1 01 . 9880,  £  <.002. 

The  above  derived  statistic  shows  that  self-paced 
individualized  instructional  practices  are  not  superior 
to  traditional  instructional  practices.   in  fact,  the 
reverse  could  be  implied;  that  traditional   instructional 
practices  are  superior  to  self-paced  individualized 
instructional  practices.   The  probability  of  .002  for 


this  combined  significance  test  indicated  that  in  998 

of  every  1,000  cases  this  result  would  be  replicated. 

In  other  words,  it  was  very  unlikely  that  this  result 
came  by  chance. 


CHAPTER  I 
INTRODUCTION 


Need  For  The  Study 

The  school  administrator  has,  among  others,  the 
functions  of  decision  maker  and  instructional  leader.   The 
accountability  movement  has  brought  considerable  pressure  on 
the  local  school  administrator  to  justify  the  programs  and 
practices  which  have  been  and  are  being  used  in  the  class- 
rooms.  The  pressure  exerted  by  the  accountability  movement 
has  caused  administrators  to  scrutinize  more  carefully  the 
instructional  practices  used  in  their  schools.   In  the  past, 
many  instructional  innovations  have  been  advanced  and  adopted 
because  of  emotional  or  philosophical  commitments  made  by 
educational  leaders  and  not  because  of  evidence  garnered 
through  the  empirical  research  process. 

The  results  of  educational  research  have  also  provided 
a  tenuous  base  upon  which  to  build  classroom  practices.   One 
of  the  reasons  for  this  was  that  classroom  practices  have 
often  been  predicated  on  the  basis  of  one  or  two  research 
studies  or  on  no  research  at  all.   Very  often  one  researcher's 
conclusions  have  contradicted  another's  with  all  of  this  pro- 
ducing a  state  of  confusion  among  educational  decision  makers 
and  practitioners. 


Pressure  from  the  demands  of  the  accountability  move- 
ment, coupled  with  the  historically  capricious  results  of 
educational  research  and  with  the  tendency  of  educators  to 
emotionally  commit  themselves  to  new  ideas,  has  resulted  in 
many  educational  methodologies  having  been  adopted  apart  from 
any  consistent  empirical  validation.   Self-paced  individual- 
ized instruction  was  one  such  methodology.   Some  researchers 
have  reported  that  self-paced  individualized  instruction  was 
superior  to  traditional  classroom  practices.   Others  have 
reported  the  opposite  result  and  many  more  have  reported  that 
there  was  no  difference  in  the  two  methodologies  in  terms 
of  enhancing  student  achievement. 

Obviously,  new  or  better  techniques  were  needed  to  help 
resolve  the  issue.   Several  researchers  (Gage,  Note  1;  Glass, 
1976;  Light  &  Smith,  1971)  have  suggested  secondary  analysis 
techniques  as  a  means  of  resolving  the  dilemmas  that  pre- 
vailed in  educational  research  results.   Secondary  analysis 
was  needed  in  the  case  of  self-paced  i nd i v i du 1  a i zed  instruc- 
tion because  of  two  inherent  problems  that  plagued  self- 
paced  individualized  instruction  research  studies. 

The  problems  of  low  expected  relationships  and  small 
sample  size  have  been  pervasive  problems  in  all  classroom 
research  as  well  as  in  the  case  of  self-paced  individualized 
instruction.  The  school  classroom  has  been  noted  for  its 
multiplicity  of  variables.  All  these  variables  could  have  an 
effect  on  the  results  of  instruction.  Therefore,  the  ex- 
pected relationship  of  any  one  variable  (whether  textbook. 


teacher  style,  room  temperature,  instructional  method, 
etc.)  to  a  learning  outcome  (grade  or  test  score)  was 
automatically  a  low  relationship.   Generally,  no  one  variable 
would  have  a  high  correlation  with  any  other  variable.   A 
second  problem  plaguing  all  classroom  research  has  been  that 
of  small  sample  size.   It  has  been  difficult  to  generalize 
the  results  of  classroom  research  to  larger  populations  be- 
cause the  original  studies  were  carried  out  with  small 
samples.   There  were  other  problems  generated  by  the  use  of 
small  samples  and  these  were  discussed  later  in  this  study. 

Studies  completed  on  self-paced  individualized  instruc- 
tion seemed  to  fit  the  pattern  which  had  been  evident  in 
other  educational  research.   Secondary  analysis  techniques 
were  needed  in  order  to  resolve  the  inconsistent  pattern  of 
research  results  coming  from  studies  done  on  self-paced 
individualized  instruction.   A  secondary  analysis  technique 
called  the  aggregate  chi-square  was  suggested  by  Gage  (Mote  1) 
as  a  possible  solution  to  the  pervasive  problems  affecting 
classroom  research.   The  following  sections  are    a  more  de- 
tailed discussion  of  the  accountability  movement  and  its 
effect  on  classroom  practices,  the  weakness  of  past  educa- 
tional research,  the  tendency  of  educators  to  commit  them- 
selves to  innovative  ideas  before  or  without  empirical  vali- 
dation, the  need  for  secondary  analysis  in  educational  re- 
search, the  two  pervasive  problems  in  educational  research, 
the  potential  solution,  and  why  administrators  need  a  more 
sound  base  from  which  to  make  decisions. 


Accountability  Demands  Justification 
of  Classroom  Instructional  Strategies 

The  "formidable  force"  (Sciara  &  Jantz,  1972,  p.  3) 
of  accountability  has  been  a  part  of  the  educational  scene 
since  1963.   Darland  (1970)  called  it  a  "national  crisis" 
and  asserted  that  "the  American  teacher  has  become  a  most 
likely  candidate  for  scapegoat  of  the  1970's  (p.  '♦I). 

But,  according  to  Briner  (1969),  it  is  the  school  admin- 
istrator who  has  been  and  will  continue  to  be  the  scapegoat. 

Teachers,  parents,  and  others  apparently 
don't  want  to  be  fully  accountable  for 
improving  education.   They  tend  to  be 
consumed  by  their  typical  social  and 
professional  roles.   On  the  other  hand, 
administrators  must  be  directly  account- 
able.  It  is  their  essential  reason  for 
being.   They  are  the  ones  upon  whom  the 
hands  of  approval  or  disapproval  will  be 
laid.   Accordingly,  their  roles  require 
orientation  and  commitment  to  educational 
success  and  the  elimination  of  failure. 
In  their  performance,  they  can  be  expected 
to  explain  both  success  and  failure;  they 
must  be  capable  of  proposing  educational 
improvements  to  the  satisfaction  of  stu- 
dents, teachers,  parents,  and  others, 
(p.  205) 

The  move  to  accountability  in  education  has  produced 
an  "imperative"  (Hostrop,  Mec k 1 enba r ge r ,  &  Wilson,  1973, 
preface)  force  upon  educators  (whether  teacher  or  adminis- 
trator) to  show  "proof  of  results"  (Lessinger,  1971,  p.  13)- 
In  addition,  Lessinger  asserted  that  general  results  will 
not  be  proof  enough.   "We  must  go  beyond  such  general  out- 
lines of  general  results  and  find  out  what  specific  factors 
produce  specific  education  results"  (p.  13). 


Authors  of  articles  and  books  on  educational  account- 
ability have  stressed  two  important  factors.   First,  that 
educators  must  be  able  to  show  which  instructional  methods 
and  programs  are  successful  and  second,  (and  more  specific- 
ally) success  of  educational  programs  will  be  measured  in 
terms  of  pupil  achievement. 

Thus,  for  our  purposes,  classroom 
activities  will  be  deemed  successful 
if  they  induce  desired  changes  in 
pupils.   Such  a  position  requires  us-- 
even tua 1 1 y-- to  validate  the  practices 
of  teaching  with  product  variables 
[product  variables  are  evidences  of 
change  in  students  as  a  result  of  their 
involvement  in  the  classroom]. 
(Dunki  n  S  Biddle  ,  ISy*,  P-  ^^8) 

The  forces  of  accountability  have  demanded  and  will 
continue  to  demand  specific  results  from  specific  programs 
(Berry,  1977,  p.  ^) ■        Educators  have  not  been  and  are  still 
unable  to  document  with  empirical  evidence  the  merit  of  class 
room  practices.   The  "bottom  line"  in  education  is  proof  of 
results.   Educators  have  been  unable  to  offer  the  proof 
demand  ed  . 
The  Weakness  of  Educational  Research 

In  1953,  the  Committee  on  Teacher  Effectiveness  of  the 
American  Educational  Research  Association  reported  the 

follovjing  conclusions. 

The  simple  fact  of  the  matter  is  that, 
after  'iO    years  of  research  on  teacher 
effectiveness  during  which  a  vast  num- 
ber of  studies  have  been  carried  out, 
one  can  point  to  few  outcomes  that  a 
superintendent  of  schools  can  safely 
employ  in  hiring  a  teacher  or  granting 
his  tenure,  that  an  agency  can  employ 


in  certifying  teachers,  or  that  a 
teacher -educa t i on  faculty  can  employ 
in  planning  or  improving  teacher- 
education  programs.    (p.  657) 

Twenty-one  years  later,  Dunkin  and  Biddle  {\37^)     con- 
cluded that  "those  who  are  seeking  simple  answers  to  the 
problem  of  teacher  effectiveness  are  only  slightly  better 
off  today  than  they  were  twenty  years  ago"  (p.  16) .   Two 
years  after  Dunkin  and  Biddle,  the  following  observation  was 
made. 

The  status  of  numerous  innovative  in- 
structional strategies  is  extremely 
tenuous,  with  many  being  perpetuated 
by  a  false  sense  of  empirical  security. 
Teachers  are  implementing  a  variety  of 
techniques  which  they  assume  to  be 
superior  but  which  have  not  been  proven 
in  practice,  at  this  point  in  time. 
(George  &    Maxwell,  1976,  p.  56) 

Education  has  had  a  history  of  weak  empirical  valida- 
tion of  its  programs  and  practices.   "Educational  research 
typically  follows  innovation  and  hence  has  little  construc- 
tive effect  on  educational  practice"  (Good,  Biddle,  &  Brophy, 
1975 ,  p.  vi  i )  . 

The  preceding  comments  were  made  by  professional 
educators  all  of  whom  are  deeply  committed  to  achieving 
quality  in  education  through  empirical  research.    If,  in 
their  judgment,  educational  practices  have  been  and  still 
are  based  on  a  tenuous  empirical  foundation,  is  it  any  wonder 
that  the  educational  establishment  has  been  forced  into  a 
defensive  position  by  the  accountability  movement. 


The  "Commitment"  of  Educators 
to  Individualized  Instruction 

Individualized  instruction  is  an  educational  practice 
that  needs  empirical  justification.   Educators  have  made  a 
heavy  commitment  to  individualized  instruction.   Dunkin  and 
Biddle  (197^)  defined  commitment  as  "advocating  innovative 
ideas  for  improving  education"  when  those  ideas  are  "attrac- 
tively argued  but  unsupported  by  data"  (p.  51). 

Individualized  instruction  became  one  of  the  basic 
commitments  of  the  education  profession  under  the  pressure  of 
accountability.   Morris  (1971)  in  commenting  on  "ten  things 
accountability  will  require"  stated  that  one  of  those  require- 
ments will  be  a  commitment  to  individualized  instruction. 

Education  must  become,  not  only  in 
theory  but  in  fact,  child  centered. 
We  will  be  forced  to  write  programs 
for  each  child  based  on  extensive  re- 
sults of  highly  sophisticated  diag- 
nostic instruments.   (p.  326) 

Another  writer  (Davies,  1970)  supported  Morris' 
prediction. 

Teachers  and  all  school  personnel  are 
involved  in  the  search  for  answers  to 
critican  questions  such  as  these: 

How  do  we  move  from  a  mass  approach 
to  teaching  and  learning  to  a  highly  in- 
dividualized approach? 

How  do  we  go  about  the  "simple" 
task  of  treating  each  child  as  an  individ- 
ual human  being?   (p.  129) 

Davies'  and  Morris'  comments  were  made  in  response  to 

the  accountability  movement  which  was  beginning  to  have  a 

strong  impact  (Hostrop  et  al.,  preface)  on  education  at  the 

time  of  their  writings. 


Professional  educators  have  more  recently  affirmed 

their  commitment  to  individualized  instruction.   Saylor 

(1977)  wrote  in  the  guest  editorial  of  the  January  issue  of 

Educational  _Leadership  the  following  statement: 

Judgments  about  the  quality  of  edu- 
cation must  be  rendered  in  terms  of 
how  well  the  school  is  developing 
the  respective  set  of  talents,  capa- 
bilities, and  potentialities  of  each 
student  for  living  a  life  of  personal 
satisfaction  and  compa s s i ona t enes s  in 
our  society.   (p.  2^5) 

The  subsequent  February  issue  of  Educa t  ional  Leadersh  i  p 
was  devoted  to  the  topic  of  individualized  Instruction. 
Anderson,  in  the  guest  editorial  to  that  issue,  wrote  that 
"the  resolve  of  most  educational  leaders  is  to  pursue  the 
path  toward  individualization"  (p.  32k).        It  was  apparent 
that  educators  have  made  the  commitment  to  individualized  in- 
struction.  Have  the  results  of  classroom  research  supported 
this  commitment?   It  was  unlikely  that  a  commitment  to  in- 
dividualized instruction  was  justifiable. 

Educational  Leadership,  as  noted  above,  devoted  its 
February,  1977,  issue  to  individualized  instruction.   Follow- 
ing are  some  of  the  comments  by  different  authors  in  that 

issue. 

Individualized  instruction  is  an  ex- 
cellent example  of  the  truth  that 
educational   innovations  should  be 
tried  cautiously,  with  proof  demanded 
that  they  actually  produce  better  re- 
sults.  (Weber  ,  p  .  328) 


I  am  pessimistic  that  the  concept  will 
survive  [that  is,  the  concept  of  mas- 
tery of  learning]  unless  the  practice 
of  individualized  instruction  proves  to 
be  more  effective.   (Block,  p.  3^1) 

The  results  have  been  conclusive.    Imple- 
mentation of  the  ACIL  [Arizona  Consortium 
for  Individualized  Learning]  process  works 
for  students,  teachers,  administrators, 
and  parents.   (Webb  &  Howard,  p.  356) 

In  a  time  which  has  been  described  as 
education's  Age  of  Individualized  In- 
struction there  is  a  pressing  need  for 
a  comprehensive  evaluation  of  all  in- 
structional strategies  [instructional 
strategies  pertaining  to  carrying  out 
the  individualized  instruction  concept]. 
(George  &  Maxwell ,  p.  57) 

Secondar  y  Analysis:   A_New 
Trend  in  Educational  Research 

The  pressure  of  the  accountability  movement  and  the 
historical  unreliability  of  educational  research  has  caused 
educators  to  seek  new  ways  to  conduct  research  on  instruc- 
tional strategies. 

In  educational  research,  we  need  more 
scholarly  effort  concentrated  on  the 
problem  of  finding  the  knowledge  that 
lies  untapped  in  completed  research 
studies.   .  .  .   The  best  minds  are 
needed  to  integrate  the  staggering 
number  of  individual  studies.   This 
endeavor  deserves  higher  priority 
now  than  adding  a  new  experiment  or 
survey  to  the  pile.    (Glass,  1976,  p.  ^) 

Glass  (1976)  was  referring  to  a  relatively  new  approach 

(of  which  he  was  a  forerunner)   in  educational  research.   The 

new  approach  has  been  called  "secondary"  or  "meta"  analysis 

(Glass,  1976,  p.  3).   The  basic  thrust  of  secondary  analysis 

is  that  the  researcher  analyzes  previously  done  analysis  on 

a  given  topic  or  variable  (analysis  of  analysis). 


0 


Two  conditions  in  educational  research  have  led  to  the 
need  for  secondary  analysis.   One  condition  is  that  there 
is  a  proliferation  of  studies  on  a  wide  variety  of  educa- 
tional topics,  but  little  has  been  done  to  integrate  the  re- 
sults of  the  many  individual  studies. 

A  second  condition  is  that  the  "fragile  and  confusing 
findings"  which  has  been  characteristic  of  all  educational 
research  (Glass,  1976,  p.  3).   "Where  ten  studies  might 
suffice  to  resolve  a  matter  in  biology,  ten  studies  on  com- 
puter assisted  instruction  or  reading  may  fail  to  show  the 
same  pattern  of  results  twice"  (p.  3). 

The  key  problem  v;as  that  of  integrating  the  findings. 
How  shall  educational  researchers  integrate  the  varied  re- 
sults?  There  have  been  at  least  three  approaches  to  the 
problem  of  integration  of  research  findings. 

One  attempt  at  integration  has  been  made  by  simply 
discarding  all  of  the  studies  of  a  given  set  which  have  not 
been  done  with  acceptable  designs  or  systems  of  statistical 
analysis.   This  method  of  integration  leaves  the  researcher 
with  a  set  of  studies  which  are  technically  near  perfection 
in  terms  of  design  and  analysis.   Glass  decried  this  method 
and  commented  "that  this  approach  takes  design  and  analysis 
too  seriously"  (Glass,  1976,  p.  k) .        Glass  further  commented 
that   "eliminating  the  'poorly  done'  studies  is  to  dis- 
card a  vast  amount  of  data"  (p.  ^). 


1 1 

A  second  method  of  integration  has  been  to  collect  a 
significant  number  of  studies  done  on  a  qiveri  variable  and 
compare  the  reported  statistics  in  terms  of  the  direction 
of  significance.   Dunkin  and  Biddle  (197^*)  used  this  method 
in  their  comprehensive  review  of  the  research  on  teaching. 
The  inconclusive  results  reflected  in  the  Ounkin  and  biddle 
book  are  what  led  Gage  (Note  1)  to  pursue  a  secondary 
analysis  of  the  same  data. 

Secondary  analysis,  then,  is  the  third  method  which  has 
been  used  to  integrate  research  data.   Glass  (1976);  Light 
and  Smith  (1971);  and  Gage  (Note  1)  have  suggested  various 
approaches  and  statistical  techniques  for  secondary  analysis, 
The  method  of  secondary  analysis  used  in  this  study  follows 
the  aggregate  chi-square  described  by  Gage  (fJote  1).   The 
use  of  the  aggregate  chi-square  procedure  was  especially 
appropriate  because  of  two  problems  that  are  inherent  in 
educational  research. 
Two  Pervasive  Problems  of  Classroom  Research 

Why  have  educators  been  unable  to  substantiate  class- 
room practices  through  empirical  research?   Gage  (Note  1) 
identified  two  factors  that  continually  plague  educational 
research.   One  factor  was  that  of  the  "expected  relationship' 
of  any  single  teaching  variable  to  the  effect  on  students 
who  are  exposed  to  that  variable.   A  second  factor  was  the 
effect  of  small  sample  size  (Gage,  Note  1,  pp.  8-9). 
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Gage  has  pointed  out  that,  first,  the  relationship  of 

"any  single  variable  of  teacher  behavior"  to  that  of  pupil 

achievement  was  "probably  low" 

On  the  face  of  it,  the  teaching- 
learning  process  is  so  complex  that 
any  single  variable  of  teacher  be- 
havior should  have  only  a  low  corre- 
lation (ranging  from  about  +  .1  to 
about  +  .h)     with  student  achievement 
or  attitude.   (Gage,  Note  1,  p.  8) 

A  second  problem  that  plagued  educational  researchers 
was  the  problem  of  small  sample  size.   .Most  educational  re- 
search was  based  on  relatively  small  numbers  of  teachers. 

For  a  sample  of  the  median  size, 
namely,  15  teachers,  it  is  necessary 
that  a  correlation  coefficient  equal 
.51  if  it  is  to  be  significant  at 
the  .05  level.  The  coefficient  must 
equal  .  6A  if  it  is  to  be  significant 
at  the  .01  level.   (Gage,  Note  1,  p.  8) 

When  the  two  problems,  low  expected  relationships  and 
small  sample  size,  were  combined,  it  was  not  unexpected 
that  most  of  the  studies  in  educational  research  would  not 
attain  statistical  significance. 

Is  it  possible  to  gain  significant  knowledge  from 
classroom  research  that  has  the  inherent  problems  of  low 
expected  relationships  and  small  sample  size?   Can  classroom 
research,  faced  with  the  two  inherent  problems  just  des- 
cribed, justify  the  programs  and  practices  being  used  in 
American  classrooms  through  empirical  research  (specifically, 
self-paced  individualized  instruction)? 


13 


A  Potential  Solution 

Gage  followed  his  description  of  the  problems  with  a 
potential  solution.   It  is  a  method  for  testing  the  sig- 
nificance of  combined  results.   Gage  applied  the  aggregate 
chi-square  model  to  five  clusters  of  studies  that  had  been 
done  on  different  teacher  behavior  variables  (Gage,  Note  1, 
p.  13).   By  applying  the  aggregate  chi-square  model,  Gage 
was  able  to  show  that  teacher  variables  (such  as  "praise") 
had  significant  relationships  to  student  achievement.   The 
importance  of  those  findings  is  that  in  most  previous  re- 
search on  those  same  variables,  those  variables  did  not 
prove  to  have  a  significant  relationship  to  student  achieve- 
ment.  Gage  summarized  the  importance  of  his  findings  in  the 
following  paragraph: 

These  tests  of  combined  results  do  iri- 
deed  reveal  some  significant  relation- 
ships between  types  of  teacher  behavior 
and  student  achievement  or  attitude. 
Thus,  the  results  suggest  that  seeking 
such  process -product  relationships  is 
not  altogether  fruitless.   They  bear 
out  the  widely  held  and  hard  to  surrender 
intuition  that  how  teachers  behave  mal<es 
a  difference  in  what  students  learn. 
(p.  15) 

The  method  used  by  Gage  and  the  resultant  findings 
indicate  that  research  on  teaching  may  not  be  as  ambiguous 
as  previously  believed. 

Because  the  results  of  independent  research  studies 
done  on  self-paced  individualized  instruction  presented  the 
same  ambiguous  picture  as  studies  done  on  many  other  in- 
structional variables,  it  was  appropriate  to  apply  the 


aggregate  chi-square  procedure  in  a  secondary  analysis  of 

self-paced  individualized  instruction. 

Administrator  Need  for  Objective  Data 

Regarding  Self-Paced  Individualized  Instruction 

Individualized  instruction  (specifically,  self-paced) 
was  a  classroom  instructional  practice  widely  adopted  and 
touted  as  the  answer  to  the  demands  of  accountability.   In- 
dividualized instruction  was  also  advanced  as  the  means 
through  which  the  individual  could  reach  his  maximum  poten- 
tial.  Furthermore,  it  was  written  in  a  leading  educational 
journal  that  "the  resolve  of  most  educational  leaders  is  to 
pursue  the  path  toward  individualization"  (Anderson,  1977, 
p.  32M  . 

Did  the  accumulated  empirical  evidence  from  research 
done  on  self-paced  individualized  instruction  justify  such 
a  strong  commitment?  The  evidence  did  not  justify  such  a 
commitment.  However,  the  empirical  evidence  did  not  pre- 
clude such  a  commitment  either.  As  was  mentioned  earlier  in 
this  study,  the  research  on  self-paced  individualized  in- 
struction was  inconsistent  and  therefore  inconclusive. 

In  the  face  of  the  pressures  from  educational  consumers 
(accountability)  and  from  educational  professionals,  an  ad- 
ministrator needed  a  more  objective  data  base  from  which  to 
generate  a  viable  decision.   Decisions  involved  with  an 
innovation  such  as  self-paced  individualized  instruction 
were  not  insignificant  in  terms  of  finances,  administrator 
time,  teacher  time,  in-service,  curriculum  changes,  hardware, 


software,   e  t  c.   Stronger  empirical  evidence  regarding 
self-paced  individualized  instruction  was  needed. 

Statement  of  the  Problem 
The  problem  of  this  study  was  to  determine  the  effec- 
tiveness of  self-paced  individualized  instruction  by  apply- 
ing the  aggregate  chi-square  statistical  procedure  to  the 
results  of  several,  previously  done,  independent  studies 
which  have  analyzed  self-paced  individualized  instruction  in 
its  relationship  to  student  achievement.   What  would  be  the 
result  when  these  several  independent  results  were  pooled  to 
derive  a  single  statistic? 

Delimitations  and  Limitations 


In  a  study  of  this  nature  there  are  certain  constraints 
on  any  results  that  might  be  obtained.   The  following  de- 
limitations and  limitations  are    explanations  of  the  con- 
straints applicable  to  this  study. 
Del  imitations 

1.  The  purpose  of  this  study  was  to  investigate  the 
aggregate  main  effect  of  self-paced  individualized 
instruction  on  pupil  acPiievement.   Consequently, 
interaction  effects  from  within  or  across  the  in- 
dividual studies  were  not  investigated. 

2.  The  test  of  combined  significance  bore  upon  a 
question  being  asked  about  the  cluster  of 
studies  as  a  whole  and  consequently  did  not  bear 


J 


16 
on  any  of  the  individual  studies  in- 
cluded in  the  cluster.   That  is,  the  com- 
bined result  does  not  change  and  cannot  be 
construed  to  change  the  previous  results  of 
the  independent  studies. 
3.    It  was  beyond  the  scope  of  this  study  to  make 
an  assessment  of  the  experimental  studies 
analyzed  except  that  they  met  the  criteria 
outlined  in  the  procedures  section. 
k.  The  set  of  11  studies  used  to  obtain  the 

pooled  statistic  was  not  exhaustive  (it  did  not 
include  all  possible  studies  done  on  that  subject 
or  that  grade  level). 
Limitations 

1.  The  results  of  this  study  are    not  decisive  or 
final  in  the  case  of  self-paced  individualized 
instruction  and  its  effect  on  pupil  achievement. 
Replications  of  this  type  of  study,  other  secon- 
dary analysis  techniques,  or  other  original  re- 
search would  be  necessary  to  support  the  con- 
clusions reached  in  this  study. 

2.  The  results  of  this  study  were  not  gene r a  1  i za b 1 e 
beyond  self-paced  individualized  instruction  at 
the  high  school  level   in  mathematics  oriented 
subjects  . 
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Definition  of  Terms 


For  the  purposes  of  this  study,  the  following  terms 
were  used  as  defined  below. 

Control  group.   In  experimental  studies,  "the  control 
group  does  not  receive  the  experimental  treatment  [inde- 
pendent variable]"  (Huck,  Cormier,  &  Bounds,  197'^,  p.  2^*5). 
The  control  group  must  be  equivalent  to  the  experimental 
group  in  respect  to  all  crucial  variables.   Equivalency  of 
control  and  experimental  groups  is  usually  achieved  by  random 
assignment  of  subjects  to  groups.   Other  equalization  tech- 
niques are  often  necessary  to  support  random  assignment  and 
to  insure  equalization  of  control  and  experimental  groups. 

Dependent  variable  .   "The  researcher  in  experimental  re- 
search must  first  identify  those  dependent  variables  which 
will,  taken  together,  make  a  reasonable  test  of  the  independ- 
ent variable?  (Fox,  1969,  P-  ')60).   The  selection  of  dependent 
variables  is  determined  by  the  research  problem,  stated  hy- 
pothesis, and  the  class  or  type  of  dependent  variable  or 
variables  being  measured.   Some  dependent  variables  may  be 
measures  of  achievement  (as  one  class  or  type)  while  others 
may  be  associated  with  attitude.   Some  dependent  variables 
measure  long-term  results  while  others  measure  short-term 
results.   The  dependent  variable  must  be  consistent  with  the 
purposes  of  the  research  problem,  measure  results  that  cor- 
respond to  the  hypothesis  being  tested,  and  be  measured  with 
instruments  that  are  valid  for  the  particular  subjects  being 
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used  in  the  study.   The  goal  of  the  researcher  is  to  show 
a  casual  relationship  between  the  independent  and  dependent 
variable  or  variables. 

Experimental  group.    In  experimental  studies,  "the 
group  that  receives  the  treatment  [independent  variable] 
is  called  the  exper  i  men  ta 1  o  r  treatment  group' '  (Huck  et  al., 

197^,  p.  2^5)  . 

I n  d  e  p  e  ndent  variable  .   The  independent  variable  is  the 
condition  or  conditions  that  an  experimenter  can  manipulate. 
The  experimenter  attempts  to  show  a  casual  relationship  be- 
tween the  independent  variable  and  some  outcome  measure 
(dependent  variable).   The  independent  variable  is  sometimes 
called  the  "experimental,  treatment,  or  intervention  variable" 
(Huck  et  a  1  .  ,  1  31k  ,     p.  22M  • 

I n  d  i  V  i  dualized  instruction  .   Most  authors  agree  that 
there  is  no  one  definition  for  individualized  instruction. 
"The  only  common  universal  attached  to  the  term  is  that  stu- 
dents generally  will  be  able  to  proceed  at  their  own  pace  in 
some  areas"  (Good  et  al.,  1975,  P-  l69). 

P  rocess  variable.   Process  variables  are  the  conditions 
in  a  given  classroom  that  would  be  expected  to  effect  the 
performance  of  the  pupils  in  that  classroom.   A  teacher's 
personality,  the  textbooks,  audio-visual  aids,  and  grouping 
practices  are  examples  of  process  variables. 

P roces 5 -p roduc t  research.   Process-product  research  is 
the  attempt  of  researchers  to  establish  casual  relationships 
between  specific  process  variables  and  specific  product 
variables. 
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Product  variable .   Product  variables  are  the  outcome 
measures  associated  with  given  classroom  groups  or  with 
individual  pupils.   A  pupil's  test  score  or  a  group  mean  de- 
rived from  a  set  of  test  scores  are  examples  of  product 
variables.   Test  scores  used  as  outcome  measures  are  usually 
a  measurement  of  pupil  achievement  or  pupil  attitude  toward 
s  choo  1  . 

One  and  two-tailed  tests  .   The  definition  offered  by 
Huck  et  al.,  {^Sl^,     pp.  k^-kG)     was  accepted  for  this  study 
and  it  is  as  follows: 


When 

using  some 

tests  of  signifi- 

cance,  the  resea 

rcher  must  also  de- 

c i  de 

whether  the 

test  will  be  a  one- 

tail 

ed  test  or  a 

two-  tailed  test.   A 

t  wo- 

tailed  test 

is  sensitive  to  sig- 

n  i  f  i 

cant  differences  in  either  direc- 

t  ion 

(i.e.,  greater  and  less);  the  one- 

tail 

ed  test  is  sensitive  to  differences 

in  only  one  direction  (i.e.,  greater  or 

less 

)  .   Suppose, 

for  example,  that  a 

researcher  compares  achievement  test 

scores  of  a  grou 

p  of  students  exposed 

to  a 

new  method 

of  instruction  to  the 

scores  of  a  no  the 

r  group  instructed  by 

the 

traditional 

method.   If  a  two-tailed 

tes  t 

is  used  to 

compare  the  scores  of 

both 

groups,  the 

researcher  can  answer 

tv;o 

questions: 

(1)  Do  students  under  the 

new 

method  score 

significantly  higher? 

(2) 

Do  students 

instructed  with  the 

trad 

i  t  i  ona 1  me  t  h 

od  score  higher?   On  the 

other  hand,  if  a 

one-tailed  test  is  used, 

the 

researcher  can  answer  only  one  ques- 

t  i  on 

:    ( 1 )  Do  St 

udents  under  the  new 

me  t  h 

od  score  s  i  g 

nificantly  higher? 

Also,  if  differences  are  found  to  be 
significant  at  a  certain  level  of  sig- 
nificance with  a  one-tailed  test,  the 
same  difference  with  a  two-tailed  test 
would  be  significant  at  a  level  of  sig- 
nificance twice  as  large  as  that  used 
with  a  one-tailed  test.   For  example, 
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if  the  researcher  found  a  significant 
difference  at  the  .025  level  with  a  one- 
tailed  test,  the  same  data  used  with  a 
two-tailed  test  would  be  significant 
only  at  the  .05  level. 

Traditional  instruction  .   The  researchers  whose  data 
were  pooled  in  this  investigation  used  the  term  "traditional" 
to  define  a  mode  of  instruction  which  contrasted  to  individ- 
ualized instruction.   "Traditional"  was  synonymous  with  large 
group  instruction,  the  lecture-discussion  mode,  and  teacher- 
paced  learning  environments. 


Procedures 

The  general  approach  was  to  use  the  procedures  developed 
by  Gage  (Note  1)  to  reanalyze  the  relationship  of  individualized 
instruction  to  pupil  achievement.   The  studies  identified  by 
Schoen  (1976)  were  selected  for  analysis.   The  aggregate  chi- 
square  statistic  was  applied  to  the  data  as  demonstrated  by 
Gage  . 
Source  of  Data 

The  procedure  and  rationale  for  selecting  the  source  of 
data  for  this  study  followed  closely  that  of  Gage  (Note  1). 
Gage  chose  a  process  variable  which  had  been  reported  on  in 
the  Dunkin  and  Biddle  text  (ISyM  and  which  had  inconclusive 
results  when  a  number  of  independent  studies,  reporting  on  the 
same  process  variable,  were  compared.   For  example,  teacher 
praise  was  one  process  variable  on  which  Dunkin  and  Biddle 
gathered  evidence.   The  studies  reported  on  by  Dunkin  and 
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B i d d  1  e  gave  inconsistent  results  and  presented  a  confusing 
picture  as  to  the  effect  of  teacher  praise  on  learning  out- 
comes . 

Gage  took  the  same  set  of  studies  collected  by  Dunl<in 
and  Biddle  and  applied  the  aggregate  chi-square  statistic 
to  pool  the  independent  probabilities  into  an  aggregate  state- 
ment of  significance.   As  was  reported  earlier,  the  pooled 
statistic  revealed  a  consistent  relationship  between  the  use 
of  praise  and  pupil  achievement. 

The  purpose  of  this  study  was  to  ascertain  the  relation- 
ship of  individualized  instruction  to  pupil  gain  in  academic 
achievement  by  using  the  pooled  probabilities  of  several   in- 
dependent samples.   A  survey  of  the  literature  revealed  that 
several  reviews  of  research  had  been  published  with  regard  to 
individualized  instruction.   Schoen's  (1976)  review  was  the 
one  chosen.   In  Schoen's  review,  one  researcher's  results 
favored  the  experimental  group  (individualized  instruction), 
three  other  researchers  reported  results  favoring  the  con- 
trol group  (traditional  instruction),  and  eight  other  re- 
searchers reported  results  as  not  significant  (Schoen,  1976, 

p.  35M. 

Re  qu^  i  re  men  ts  and  Statistical P  rocedu  res 

This  section  is  an  explanation  of  the  requirements  and 
procedures  (Fisher,  ]3h3  ,     pp.  99-101)  which  are  necessary 
when  applying  the  aggregate  chi-square  model  to  a  set  of  data, 
As  written  previously,  the  aggregate  chi-square  model  was 
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employed  to  reanalyze  data  from  several  selected  studies. 
By  following  the  steps  outlined  below,  the  reader  should 
be  able  to  duplicate  this  type  of  study. 

I  nd  e  pe  n  d  en  ce  of  the  s  epa  r  a_t_e_  r  es  u  1  t  s  being  combined  . 
This  means  that  each  result  used  was  obtained  from  a  dif- 
ferent sample  and  that  only  one  set  of  results  for  any  single 
sample  of  individuals  was  usable. 

Some  experimental  studies  were  done  using  several 
schools  and/or  teachers.   When  one  or  more  schools  or  teachers 
were  treated  as  separate  experimental  units  in  a  given  study, 
then  each  school  and/or  teacher  was  a  source  of  an  independent 
result  from  an  independent  sample.   For  example,  if  in  a  cer- 
tain study,  teacher  A,  teacher  B,  and  teacher  C  were  each 
assigned  to  a  control  group  and  to  an  experimental  group,  the 
statistical  results  were  independent  for  each  teacher.   The 
sample  of  students  for  teacher  A  was  separate  from  each  other 
set  of  control  and  experimental  groups.   Likewise,  the  sample 
associated  with  teacher  B  and  the  sample  associated  with 
teacher  C  was  separate  and  independent  of  each  other. 

For  another  example  (which  is  a  somewhat  different  case 
than  the  one  noted  above),  if  in  a  given  study  there  is  more 
than  one  dependent  variable  (criterion  measure),  the  inde- 
pendence of  the  statistical  results  can  be  maintained  by  re- 
porting the  least  significant  chi-square,  the  most  signifi- 
cant chi-square,  and  a  mean  (mean  of  the  two  or  more  results 
chi-square  (Gage,  Note  1,  pp.  1'+  &  33)- 
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Ratio  nal  basis  for  combining  the  studies  .   All  of  the 
studies  must  investigate  the  same  variable.   An  example 
would  be  a  set  of  studies  all  of  which  investigated  the  re- 
lationship of  time  in  class  to  student  achievement.    In  this 
study,  the  rational  basis  was  the  use  of  the  individualized 
instruction  approach  and  its  effect  on  student  achievement. 
The  rational  basis  for  this  particular  study  was  further  de- 
fended in  Chapter  II. 

All  res  u 1  t  s  in  the  set  being  analyzed  must  be  included  . 
An  objective  means  of  achieving  the  above  criterios  was  to 
set  specific  limits  on  what  studies  were  included.   The  re- 
searcher could  use  criteria  such  as  subject  matter,  grade 
level,  studies  done  only  within  a  given  span  of  time  (I96O- 
1970,  for  example),  and/or  a  criterion  such  as  experimental 
studies  as  opposed  to  field  studies. 

Another  procedure  (the  procedure  chosen  for  this  study) 
was  to  choose  all  of  the  studies  included  in  some  review  of 
research  as  when   Gage  (Note  1)  chose  only  the  studies  reported 
by  Dunkin  and  Biddle  (197^^)  in  their  review  of  classroom  re- 
search.  The  important  consideration  was  that  the  researcher 
avoid  the  bias  that  would  occur  if  he  chose  only  those  studies 
which  offered  near  significance. 

K n o w 1 e dge  of  the  exact  one-tailed  probability  value 
associated  with  each  result  to  be  combined.   Researchers,  in 
many  cases,  have  reported  statistical  measures  such  as  F_ 
ratios,  t-ratios,  and  chi-squares.    In  addition,  those  statis- 
tics have  been  reported  as  being  either  significant  (at  a 
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given  level  of  probability)  in  favor  of  the  control  group, 
significant  in  favor  of  the  experimental  group,  or  not 
significant  (NS). 

Some  studies  were  set  up  on  the  basis  of  an  hypothesis 
which  required  a  two-tailed  test  for  significance  and  some 
hypotheses  required  a  one-tailed  test  for  significance. 

If  the  hypothesis  was  non -d i  rec t i ona 1  ,  the  exact  prob- 
ability value  associated  with  the  reported  statistic  was 
divided  by  two  (p_/2).   For  example,  if  the  hypothesis  required 
a  two-tailed  test  and  the  reported  F_    for  that  hypothesis  was 
associated  with  a  .30  probability  value,  then  the  exact  one- 
tailed  probability  value  is  .15  (.30/2).   When  the  reported 
probability  value  was  associated  with  a  one-tailed  test, 
dividing  by  two  was  unwarranted. 

D^t  e_r_m  i  nat  ion  of  the  d  irection  of  the  statistical  results  . 
Did  the  reported  statistic  favor  the  control  group  or  the  ex- 
perimental group?   The  researcher  indicated  which  group  was 
favored  when  the  statistic  was  significant.   In  many  cases, 
the  reported  statistic  was  reported  as  not  significant.   When 
this  happened,  the  actual  results  (the  group  means)  were  ob- 
tained from  the  body  of  the  original  research  report.   The 
group  means  indicated  which  group  did  better  on  the  criterion 
measure  or  dependent  variable. 

If  the  reported  statistical  result  and  the  exact  one- 
tailed  probability  associated  with  that  result  were  in  the 
same  direction  as  the  majority  of  cases  in  the  set  of  studies 
whose  statistical  results  were  being  pooled,  then  the  exact 
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one-tailed  probability  value  was  taken  directly  to  the  chi- 
square  table  for  two  degrees  of  freedom  developed  by  Gordon, 
Loveland,  and  Cureton  (1952). 

The  exact  one-tailed  probability  was  subtracted  from 
one  (1-p)  before  going  to  the  chi-square  table  with  two  de- 
grees of  freedom  if  it  was  not  in  the  same  direction  as  the 
majority  of  cases  in  the  set  of  studies  whose  statistical  re- 
sults were  being  pooled. 

Ad  justment  oX_a_a_q_r_g_q  a  t  e  one-tailed  probability  to  a 
two-_ta_i_l_e__d__pjio_bj_b_i_l_i_y^.   The  probability  derived  from  the 
aggregate  chi-square  statistic  had  to  be  doubled.   The  use 
of  one-tailed  probabilities  to  derive  the  aggregate  statistic 
and  probability  was  inconsistent  with  the  assumption  that  the 
procedure  allows  for  a  result  in  either  direction.   This  in- 
consistency is  easily  remedied  by  doubling  the  probability 
derived  from  the  aggregate  chi-square  statistic  (Gordon  et  al. 

1952,  p.  31 5) . 

S  u  m  m  a  ry  of  Procedures  _  to_r_  Treatment  of  the  Data  .   The 
following  summary  was  presented  to  help  clarify  the  individual 
steps  in  the  aggregate  chi-square  procedure. 

1.  The  exact  one-tailed  probability  associated  with 
the  reported  statistic  was  found  for  each  in- 
dependent sample. 

2.  The  direction  of  the  result  was  determined.   Was 
it  in  the  same  direction  as  the  majority  of  the 
cases  included  in  the  set  of  studies  being  pooled? 
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If  it  was  in  the  same  direction  as  the  majority, 
the  exact  one-tailed  probability  was  taken  di- 
rectly to  the  chi-square  table  with  two  degrees 
of  freedom  (Gordon  et  al.,  1952).   If  the  result 
vyas  not  in  the  same  direction  as  the  majority, 
the  probability  value  was  subtracted  from  one 
(1-p).   When  the  result  was  generated  from  a 
two-tailed  test,  the  probability  was  divided  by 
two  (p/2)  before  going  to  the  extended  table  of 
chi-square  developed  by  Gordon  et  al.,  1952. 
All  of  the  independent  chi-square  statistics  with 
two  degrees  of  freedom  were  added  together  to  ob- 
tain the  aggregate  chi-square  statistic. 
The  aggregate  chi-square  statistic  was  taken  to 
a  regular  chi-square  table  of  values  and  the 
appropriate  probability  value  was  read  from  that 
table. 

The  derived  probability  was  doubled  to  correspond 
to  the  two-tailed  assumption  which  allowed  for  a 
result  in  either  direction. 


Organization  Of  The  Study  By  Chapters 
Chapter  I  was  an  introduction  to  the  study.   Topics 
discussed  in  Chapter  I  were  need  for  the  study,  the  problem 
delimitations  and  limitations,  definition  of  terms,  and  pro- 
cedures . 
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Chapter  II  is  a  discussion  of  the  rationale  for  choos- 
ing the  set  of  II  research  reports  included  in  this  study 
which  were  all  from  the  Schoen  (1976)  review. 

Chapter  III  is  a  presentation  of  each  of  the  11  in- 
dividual research  reports  (in  abstract  form)  with  their 
statistical  results  and  the  aggregate  statistic  derived  by 
pooling  the  individual  statistics. 

Chapter  IV  is  a  summary  of  this  research  study  as  well 
as  a  discussion  of  the  conclusions,  implications,  and  sug- 
gestions for  further  research. 


CHAPTER  I  I 
SELECTI NG  A  SET  OF  STUD  I  ES 

I  ntroduct  ion 


To  accomplish  tine  purpose  of  t  In  i  s  study,  a  set  of 
independent  samples  inad  to  be  identified.   Reading  and 
mathematics  have  traditionally  been  the  most  individualized 
of  all  school  subjects.   Therefore,  a  set  of  studies  was 
sought  where  each  investigator  had  done  an  experiment  on 
individualizing  and  where  all  of  the  experiments  in  the  set 
were  on  reading  or  math,  but  not  both. 

An  additional  requirement  was  that  self-pacing  had  to  be 
an  identifiable  feature  of  each  study.   Self-pacing  has  been 
identified  as  the  only  common  denominator  among  various  in- 
dividualized programs  (Good  et  al.,  1975,  P-  169  and  Miller, 
1976,  p.  3^5). 

Miller's  Rev  i  ew 
Miller  (1976)  produced  a  review  of  research  on  individ- 
ualized mathematics  programs.   One  hundred  and  forty-five 
studies  were  included  in  Miller's  review.   The  studies  in- 
cluded were  done  over  a  wide  range  of  grade  levels  (kinder- 
garten through  college  level)  and  over  a  wide  range  of  time 
(17  of  the  studies  were  done  before  I960). 
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Primarily,  because  of  these  wide  ranges  in  grade  levels 
and  time,  Miller's  review  was  not  used.   An  additional  rea- 
son vias     that  the  sources  of  data  were  so  varied  that  a  great 
amount  of  time  and  expense  would  have  been  necessary  to  sort 
out  and  track  down  a  representative  set  of  studies. 

Hirsch's  Review 

Hirsch  (1976)  reviewed  research  on  individualized  in- 
struction in  secondary  mathematics.   Thirty-three  studies 
were  reviewed.   The  grade  level  range  of  the  studies  was  from 
grade  seven  through  grade  twelve.   The  time  range  was  from 
1967  through  197^. 

Although  Hirsch  had  narrowed  the  field  considerably 
from  that  of  Miller  (1976),  the  grade  level  span  was  not  ideal 
Time  and  expense  were  also  a  factor  in  deciding  against  using 
Hirsch  as  a  sou  rce . 


Schoen's  Review 

The  set  of  studies  chosen  was  taken  from  Schoen's  (1976) 
review  which  he  titled  "Self-paced  Mathematics  Instruction: 
How  EFfective  Has  It  Been  in  Secondary  and  Pos t s econda r y 
Schools?"   Schoen's  review  contained  within  it  a  subset  of 
studies  in  which  the  researcher  had  investigated  individual- 
ized (self-paced)  mathematics  programs  at  the  secondary  level 
(pp.  353-35'4). 

This  was  an  appropriate  set  of  studies  to  use  to  in- 
vestigate (by  applying  the  aggregate  chi-square  methodology) 
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the  true  strength  of  individualization  as  an  educational 
strategy.   First,  it  was  appropriate  because  Schoen  (1976) 
specifically  identified  self-pacing  (p.  352)  as  a  common 
factor  in  all  of  the  studies  which  he  had  included  in  the 
review.   Self-pacing  was  the  key  element  because  self-pacing 
has  been  identified  as  "the  only  common  universal  attached 
to  the  term  .  .  ."  individualization  (Good  et  al.,  1975, 

p.  169). 

The  fact  that  self-pacing  was  a  unifying  factor  supported 
the  requirement  that  there  be  a  rational  basis  for  combining 
the  studies.   The  fact  that  all  of  the  studies  included  in 
Schoen's  review  of  research  were  further  narrowed  to  include 
only  secondary  level  studies  and  only  mathematics  programs 
helped  to  support  the  rational  basis  for  their  inclusion  in 
an  aggregate  chi-square  methodology. 

Second,  Schoen's  review  was  appropriate  because  each 
study  included  in  the  review  had  many  characteristics  which 
have  been  commonly  identified  with  the  individualized  model 
and  thus  support  (in  addition  to  self-pacing)  the  rational 
basis  for  establishing  them  as  a  set  to  be  pooled  by  the  chi- 
square  model. 

First,  they  were  based  on  a  specific 
set  of  behavioral  objectives.   Second, 
the  mathematics  content  to  be  learned 
was  divided  into  small  modules  or  units. 
Third,  learning  packets  were  written  for 
each  unit;  the  learning  packets  served 
as  guides  for  the  students,  enabling 
them  to  proceed  more  or  less  independ- 
ently through  the  content  at  their  own 
pace.   Fourth,  for  the  most  part  the 
students  learned  independently  from 
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textbooks  and  worksheets,  through  some  pro- 
grams included  other  media.   Fifth,  each 
packet  contained  pretests  and  posttests: 
the  student  was  required  to  pass  one  or  both 
before  proceeding  to  the  next  unit.   The 
teacher's  role  was  that  of  manager,  record 
keeper,  individual  tutor,  and  sometimes  cur- 
riculum developer.   (Schoen,  1976,  p.  352) 

The  five  general  characteristics  just  quoted  plus  the 
self-pacing  characteristic  established  the  fact  that  the 
studies  included  in  Schoen's  review  contained  studies  which 
were  in  fact  models  of  individualization  and  thus  met  the 
rational  basis  requirement. 

Third,  the  studies  included  in  Schoen's  review  were 
appropriate  because  of  the  definite  ambiguity  of  the  results. 
Of  the  twelve  studies  included  in  the  review,  one  (Bull, 
1971)  concluded  that  students  studying  mathematics  with  the 
individualized  approach  scored  better  than  students  studying 
with  a  traditional  approach.   Conversely,  Fisher  (1973), 
Herceg  (1972),  and  Hirsch  (1972)  all  concluded  that  the 
traditional  approach  was  better. 

In  contrast  to  the  four  previously  named  researchers 
who  found  a  significant  difference  in  mathematics  achievement 
depending  on  the  method  of  instruction  used,  eight  research- 
ers reported  no  significant  difference  in  either  method 
(Englert,  1972;  ffanneman,  1971;  Ludeman,   1973, 
Penner,  1972;  Schoen  &Tcdd  (Note  2);  Schoen  &  Todd,  197^; 
Taylor,  1 971  ;  Thomas,  1 972)  . 

Fourth,  the  general  quality  of  the  research  designs  and 
statistical  analyses  were  of  high  quality.   Random  assignment 
of  students  or  classes  to  treatments  was  the  basic  way  in 
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which  group  equivalency  was  obtained.   Analysis  of 
covariance  and  analysis  of  change  from  a  pretest  to  a 
posttest  score  were  used  to  support  random  assignment  in 
attempting  to  insure  p r e - t r ea tmen t  group  equivalency 
(Schoen,  1976,  p.  353). 

The  criterion  measure  used  was  either  a  standardized 
test  or  a  teacher-made  test.   Many  of  the  studies  measured 
criteria  other  than  but  including  achievement.   Attitude 
toward  the  content  being  taught  or  learned  was  the  crite- 
rion most  often  measured  other  than  achievement. 

Fifth,  another  potentially  important  factor  was  that 
the  collection  of  studies  in  Schoen's  review  was  relatively 
recent.   Bull's  1971  study  and  Schoen's  197'*  study  represent 
the  extremes  on  a  time  continuum. 

Sixth,  the  studies  were  relatively  easy  to  acquire. 
Nine  of  the  studies  were  doctoral  dissertations  and  were 
readily  available  through  University  Microfilms  of  Ann  Arbor, 
Michigan.   One  study  was  reproduced  by  the  United  States 
Educational  Resources  Information  Center  (ERIC). 

Seventh,  by  using  the  self-contained  set  produced  by 
Schoen  (1976),  this  researcher  was  able  to  avoid  the  re- 
searcher bias  (Gage,  Note  1,  p.  13)  of  choosing  a  self- 
selected  set.   Only  one  study  from  the  Schoen  review  was 
not  used  and  that  was  due  to  its  unavailability  and  not  to 
any  arbitrary  decision  by  this  researcher. 

Eighth,  the  set  of  studies  reported  on  by  Schoen  pro- 
vided enough  independent  samples  so  that  the  results  of 
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this  investigation  would  be  defensible.   That  is,  there 
were  enough  separate  measures  included  in  the  pooled  data 
to  insure  reliability  of  the  aggregate  chi-square  statis- 
tic.  Fisher  {\ 3kQ  ,     p.  lOO)  used  3  independent  samples  in 
arriving  at  an  aggregate  chi-square  statistic.   Gage  (Note 
1,  p.  33)  used  18  independent  samples  and  Gordon  et  al. 
(1952,  p.  315)  used  13  independent  samples.   In  this  inves- 
tigation, 2h     independent  samples  were  used  to  arrive  at 
the  aggregate  chi-square  statistic. 

As  was  noted  earlier  in  this  chapter,  Schoen  and  Todd 
had  two  separate  investigations  which  were  both  done  in  IS?'^. 
Only  one  of  Schoen  and  Todd's  (Note  2)  studies  was  available 
in  a  form  which  included  group  means.   The  Schoen  and  Todd 
(Note  2)  study  with  group  means  was  available  from  the 
authors.   The  second  Schoen  and  Todd  study  which  was  included 
in  the  "Research  Reporting  Sections,  Annual  Meeting  of  National 
Council  of  Teachers  of  Mathematics  (IS?'*)"  has  not  been  used 
in  this  study.   The  group  means  were  not  available  in  the 
ERIC  document  or  from  the  authors. 


Summa  r  y 
The  main  criterion  in  choosing  a  set  of  studies  for 
use  with  the  aggregate  chi-square  model  was  that  of  estab- 
lishing the  rationale  basis  for  inclusion  of  each  study. 
In  this  case,  the  rational  basis  for  inclusion  was  the  char 
acteristic  of  self-pacing  which  was  present  in  each  study. 
Self-pacing  was  focused  on  because  it  is  the  only  common 
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element  found  in  individualized  programs  (Good   et  al., 
1975,  p.  169) . 

In  addition,  there  were  five  other  characteristics 
of  individualization  cited  by  Schoen  and  quoted  above 
which  supported  the  establishment  of  a  rational  basis  for 
inclusion  in  the  set. 

Ambiguity  of  results  was  another  feature  associated 
with  the  studies  reported  i  n   Schoe  n's  review.   Ambiguity 
of  results  was  consistent  with  other  research  done  on 
individualized  (self-paced)  instruction.   Therefore,  Schoen's 
collection  of  studies  provided  an  adequate  set  on  which  to 
apply  the  aggregate  chi-square  model. 

The  studies  in  Schoen's  review  had  been  done  over  a 
relatively  short  time  span,  were  narrowly  focused  in  terms 
of  grade  level  and  subject  matter  (when  compared  with  other 
reviews),  and  were  relatively  easy  to  acquire  in  terms  of 
time  and  cost. 


CHAPTER  I  I  I 

REPORTED  RESULTS  OF  THE  INDIVIDUAL  STUDIES 
AND  CONVERSION  TO  CHI-SQUARE 


I  n  t  roduc  t  i  on 


Chapter  III  is  a  presentation  of  each  of  the  11 
individual  research  reports  with  their  statistical  results 
and  the  aggregate  statistic  derived  by  pooling  the  individ- 
ualstatistics. 

Six  elements  of  each  study  were  identified  as  being 
appropriate  to  include.   The  6  elements  are  the  background 
data,  the  characteristics  of  individualization,  a  defini- 
tion of  experimental  and  control  groups  as  it  applied  to 
each  of  the  studies,    the  hypothesis  tested,  the  reported 
statistical  results,  and  the  conversion  to  chi-square  of 
the  reported  results. 

In  some  of  the  studies  more  than  one  hypothesis  was 
being  tested.   Where  it  was  appropriate  (and  it  was  appro- 
priate in  all  but  one  case),  only  one  liypothesis  and  the 
statistical  results  for  the  test  of  that  hypothesis  were 
reported.    In  the  one  case  (Hirsch)  where  each  of  two 
hypotheses  was  appropriate  to  be  included,  the  results  of 
each  test  of  the  hypothesis  was  reported  as  an  independent 
sample. 
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Procedures  for  carrying  out  the  conversion  to  chi- 
square  varied.  The  variation  in  procedure  depended  on 
two  factors.  One  factor  was  whether  the  hypothesis  was 
stated  as  directional  or  non -d i  r ec t i ona  I  .  A  non-direc- 
tional hypothesis  required  that  the  probability  derived 
from  the  test  of  the  hypothesis  be  divided  by  two. 

A  second  factor  that  had  to  be  considered  was  whether 
the  reported  statistical  result  was  in  the  same  direction 
as  the  majority  of  the  cases  in  the  set  of  results  being 
pooled  to  determine  the  aggregate  chi-square. 

The  set  of  independent  results  used  was  divided  in 
terms  of  favoring  experimental  or  favoring  control  as 
s  hown  in  Table  1  . 

Table  1 

Delineation  of  Reported  Results  According 
to  Favoring  Experimental  or  Control  Groups 


Experimenter 


Experimental 


Control 


Bull  (1971) 
Engl ert  (  1972) 
Fi  sher  (  1  973) 
Ha  n  nema  n  (1971) 
Herceg  (1972) 
Hi  rsch  (1 972) 
Ludeman  (1973) 
Penner  (  1 972) 
Schoen  S  Todd  (197^* 
Tay  lor  (1971) 
Thomas  (1971) 


Tota 1 s 


1  0 
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The  fact  that  the  majority  of  the  results  (as  shown 
in  Table  1)  favored  the  control  groups  was  an  important 
result  and  was  a  determining  factor  in  deriving  the  aggre- 
gate chi-square  statistic  (refer  to  Procedures  section  of 
Chapter  I),   The  direction  of  the  results  reported  as  "non- 
significant" was  determined  by  comparing  group  means 
reported  in  each  researcher's  original  data. 

The  following  sections  are  in  alphabetical  order  by 
the  author's  last  name. 

Bu  1  1  (1971) 
Background  Data 

Bull  conducted  a  s eme s t e r -  1 ong  study  in  which  he 
compared  the  achievement  of  two  individual  ized  geometry 
classes  against  the  achievement  of  two  comparable  classes 
taught  in  a  traditional  manner. 

Bull  did  the  study  at  Camelback  High  School,  Phoenix 
Union  High  School  District,  Phoenix,  Arizona. 
Characteristics  of  individualization 

The  characteristics  of  individualization  were  self- 
pacing,  use  of  behavioral  objectives,  and  self-choice  of 
learning  experiences. 
Experimental  and  Control  Groups 

The  individualized  groups  were  classed  as  experimental 
There  were  3^     students  in  each  of  the  two  experimental 
groups  and  in  each  of  the  two  control  groups.   Two  teachers 
taught  both  an  experimental  and  control  group.   A  two-by- 
two  factorial  design  was  used  to  analyze  the  effects  of 


individualization  and  time  of  day.   Students  were  ran- 
domly assigned  to  the  respective  groups. 
Hypothesis  Tested 

The  hypothesis  tested  was  stated  by  Bull  in  the 
following  manner. 

There  is  no  difference  in  the  mean  test 
score  of  geometry  students  taught  by  the 
traditional  method  and  the  mean  test  score 
of  geometry  students  taught  by  the  indi- 
vidualized instruction  method  as  measured 
by  the  Mid-Year  Geometry  Test.   (p.  11) 

Statistical  Results 

Bull  applied  the  _t_-test  to  his  non-directional  hypoth- 
esis and  obtained  the  result  V=    3.229. 
Conversion  to  Chi-square 

By  applying  the  statistical  techniques  and  extended 
table  of  chi-square  for  two  degrees  of  freedom  outlined  in 
Gordon   et  al..   (1952),  a  chi-square  of  .0201  was  obtained. 

The  transformation  was  as  follows. 

^(67)  =  3.229,  P  <.05 

p  =  1  -  (.001/27  =  .9995 

X^=  .0201 

Bull  reported  the  t_    ratio  to  have  been  significant  in 
favor  of  the  experimental  group. 

Enqlert  (1972) 
Background  Data 

Englert's  study  v;as  conducted  at  the  Cleveland  Heights 
High  School  in  Cleveland  Heights,  Ohio,   The  subjects  used 
in  the  study  were  first-year  algebra  students.   The  first- 
year  algebra  students  were  classified  as  low-achievers  and 
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the  group  was  comprised  of  pupils  from  grades  ten 
through  twelve.   The  duration  of  the  study  was  one 
semester. 
Characteristics  of  Individualization 

Englert  defined  individualization  in  the  following 
manner.   "The  emphasis  in  this  approach  is  upon  the  indi- 
vidual as  he  learns  and  proceeds  at  his  own  pace"  (p.  9). 
Experimental  and  Control  Groups 

The  experimental  group  was  that  group  of  students 
which  proceeded  through  the  text  book  at  its  own  pace. 
There  were  three  experimental  groups  taught  by  three  dif- 
ferent teachers.   For  comparison,  three  control  groups 
were  established.   Each  control  group  was  taught  by  one  of 
the  experimental  group  teachers.   Thus,  three  teachers  each 
taught  an  experimental  and  a  control  group  for  a  total  of 
six  groups  (pp.  9~10). 
Hypothes  i  s 

Englert  hypothesised  that  "there  is  no  difference  in 
algebra  achievement  levels  between  senior  high  school 
students  taught  by  the  group-oriented  approach"  (p.  51). 

The  standardized  Seattle  Algebra  Test  was  used  as  the 
criterion  measure.   The  hypothesis  was  non-directional  and 
tested  at  the  .05  level. 
Statistical  Results 

A  comparison  of  group  means  from  the  arithmetic  pre- 
test to  the  algebra  posttest  yielded  the  following  results. 
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Tabl e  2 
Group  Means  and  t-scores  for  Each  Independent  Sample 


Teacher 


Experimental 


Con  t  ro 


df 


18.05 
22.33 
20.67 


22.10 

39 

2.05 

21.30 

kl 

-  .59 

21.13 

39 

.23 

Note,  '--p  <,G5. 


Conversion  to  Chi-square 

Each  of  the  teachers  represented  an  independent  sample 
as  defined  in  the  Procedures  section  of  Chapter  I.   There- 
fore, each  chi-square  generated  from  each  independent  sample 
(teacher  A,  teacher  B,  &  teacher  C)  was  entered  in  the 
aggregate  chi-square  table  as  separate  entries. 

The  original  probability  of  each  independent  sample 
was  divided  by  two  (£/2)  because  the  hypothesis  was  non- 
di  rectional  . 

The  independent  probability  associated  with  teacher  B 
was  subtracted  from  one  ( 1 -£)  because  the  result  was  not  in 
the  direction  of  the  majority  of  the  cases  in  the  total  set 
used  for  the  aggregate  chi-square  statistic.  The  direction 
was  determined  by  comparing  the  group  means  in  the  original 
data  as  shown  in  Table  2.  Table  3  shows  the  conversion  to 
chi-square  of  the  reported  results. 
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Table  3 
Conversion  to  Chi-square  of  Each  Independent  Sample 


Teacher 


Exact  One-tailed  Probability 


X' 


A  2.05 
B  -  .59 
C       .23 


£  =  . 05/2  =  . 025 

P  =  1-(.55/2)  =  .725 

p  =  .80/2  =  .kO 


7.3778 

.6432 

1  .8326 


Total      9.8536 


Fi  sher  (1 973) 
Background  Data 

Fisher  studied  the  difference  in  effect  on  achieve- 
ment in  geometry  when  using  an  individualized  approach 
versus  a  lecture-demonstration  approach.   Fisher's  study 
was  conducted  at  Albert  Einstein  Senior  High  School, 
Montgomery  County,  Maryland.   The  duration  of  the  study 
was  one  year.   The  subjects  in  the  study  were  eleventh 
grade  geometry  students. 
Characteristics  of  Individualization 

The  computer  was  used  (computer  managed  instruction) 
to  supply  daily  monitoring  of  each  student's  progress 
through  his  program.   The  individualized  design  used  in 
Fisher's  study  permitted  "a  student  to  progress  through 
the  material  at  his  own  rate"  (p.  81). 
Experimental  and  Control  Groups 

The  sample  was  divided  into  two  groups.   One  group 
(experimental)  consisted  of  all  students  studying  geometry 
through  the  computer  managed  instruction  plan.   The  contro 
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group  consisted  of  all  the  students  studying  geometry 

by  a  traditional  geometry  curriculum.   The  criterion 

measure  was  the  standardized  Cooperative  Mathematics  Test 

for  Geometry. 

Hypothes  i  s 

Fisher  tested  the  following  directional  hypothesis. 

The  computer-managed  behavioral  objective 
instructional  curriculum  is  more  effective 
than  the  traditional  curriculum  in  develop- 
ing the  basic  skills,  concepts,  and  logical 
reasoning  skills  of  geometry  as  measured 
by  the  Cooperative  Mathematics  Test  for 
Geome  t  r  yT   (  pp .  96- 97 ) 

Statistical  Results 


Fisher's  reported  statistic  of  t^(8l)  =   -1.28,  £  >.05 
was  not  significant.   However,  when  the  group  means  were 
compared,  the  control  group  mean  was  greater  (control  group 
mean  12.23  &  experimental  group  mean  10.77)  than  the  exper- 
imental group  mean.   Therefore,  the  results  were  taken  as 
favoring  the  control  group. 
Conversion  to  Chi-square 

The  calculated  value  _^(8l)  =   -1.28,  £  >.05  was  taken 
directly  to  the  extended  table  of  chi-square  for  two  degrees 
of  freedom  (Gordon,  et  a1.,  1952).   An  exact  one-tailed 
probability  of  .20  was  obtained.   The  probability  of  .20 
yielded  a  chi-square  of  3.2189. 

The  extended  table  was  used  directly  in  this  case 
because  the  test  was  one-tailed  and  the  results  favored  the 
control  which  was  true  for  the  majority  of  the  independent 
samples  used  to  derive  the  aggregate  chi-square  statistic. 
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Hanneman  (197') 


Background  Data 

Hanneman  conducted  his  study  at  Mankato  (Minnesota) 
High  School.   The  duration  of  the  experimental  study  was 
1'4  weeks.   The  subjects  of  the  study  were  tenth-grade 
geometry  students. 
Characteristics  of  Individualization 

Individualization  was  characterized  by  self-pacing, 
self-testing  (pre  and  post)  and  learning  activity  packages 
(lap's).   End-of-unit  teacher  designed  tests  were  used  as 
the  criterion  measure  (dependent  variable). 
Experimental  and  Control  Groups 

The  experimental  groups  were  made  up  of  kS    tenth-grade 
geometry  students.   The  control  groups  were  made  up  of  47 
tenth-grade  geometry  students.   The  five  experimental  groups 
were  exposed  to  the  program  of  individualization  as  de- 
scribed in  Characteristics  of  Individualization.   The  five 
control  groups  remained  in  traditional  classrooms.   Tradi- 
tional classrooms  were  characterized  by  lecture-discussion 
and  whole  group  pacing  (all  students  received,  performed, 
and  were  tested  on  assignments  at  the  same  basic  intervals). 
Hypothes  i  s 

Hanneman's  hypothesis  was  stated  in  the  following 
manner.   "The  performance  on  end-of-unit  tests  of  students 
receiving  instruction  through  independent  study  will  not 
differ  from  the  performance  of  those  receiving  group  in- 
struction" (p.  25). 


A  two-tailed  _^-test  was  used  as  the  measure  of  the 
non -d i r ec t i ona 1  hypothesis. 
Statistical  Results 

Hanneman  organized  the  experimental  and  control  groups 
around  five  learning  activity  pacl<ages  (LAP's).   The  LAP's 
were  designed  to  be  equivalent.   The  statistical  results 
were  reported  as  independent  samples  in  terms  of  each  of 
the  five  lap's.   Table  k    shows  the  reported  results. 

Table  '( 
Group  Means  and  t-scores  for  Each  Independent  Sample 


LAP 


Control 


Experimental 


86.3 
80.0 
79.9 
79.^4 
8A.7 


8A.3 
76.5 
71.8 
76.5 
85.1 


.870 

1  .357 

2.7  6  9" 

1  .  18A 

-  .  1  9^4 


Note  . 


. 01 ,  df  was  90  for  al 1  LAP ' s 


Conversion  to  Chi-square 


Table  5 
Conversion  to  Chi-square  of  Each  Independent  Sample 


LAP 


Exact  Probabilities 


.870 
1  .357 
2.769 
I  .  I  8  'i 

.  1  9^4 


40/2    = 

.200 

3.2189 

20/2    = 

.  1  00 

'+.6052 

01  /2    = 

.005 

10.5966 

30/2     = 

.  150 

3.79'42 

87/2    = 

.'435(1- 

.'435)  = 

.565  1 .  uig 

Total    23.3568 


Note.  The  probability  for  LAP  5  was  subtracted  from  1 
because   the  experimental  group  scored  higher  than  the 
control  group  (refer  to  Table  '* )  . 
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Herceg  (1972) 
Background  Data 

Herceg  investigated  individualization  by  comparing 
the  achievement  of  16  Algebra  2  classes.   Three  top-track 
and  13  middle-track  Algebra  2  classes  were  randomly  assigned 
to  three  treatment  groups.   The  investigation  was  conducted 
in  the  Gateway  School  District  at  Monroeville,  Pennsylvania. 
The  duration  of  the  study  was  not  precisely  stated. 
Characteristics  of  Individualization 

The  students  in  Group  A  studied  Algebra  2  by  using 
computers,  behavioral  objectives,  and  were  in  an  "individ- 
ual rate  of  learning  setting"  (p.  kS) . 
Experimental  and  Control  Groups 

Group  A  students  used  the  computer  in  an  individual 
rate  of  learning  setting  with  formally  presented  behavioral 
objectives.   Group  A  was  designated  as  the  [experimental] 
group.   The  [control]  group,  Group  B,  also  used  computers 
and  formally  presented  behavioral  objectives,  but  Group  B 
students  remained  in  a  traditional  classroom  setting. 
Hypothes  i  s 

Herceg  stated  the  hypothesis  in  the  following  manner. 

Students  in  an  individual  rate  of  learning 
setting  who  are  aware  of  the  bahavioral 
objectives  for  a  unit  in  CAM  [Computer 
Assisted  Mathematics]  will  score  as  high 
as  or  higher  than  students  in  a  traditional 
classroom  setting  who  are  aware  of  the  be- 
havioral objectives  for  the  same  Computer 
Assisted  Mathematics  unit.    (p.  '(9) 


Top  track  students  and  middle  track  students  were 
tested  on  the  hypothesis  (p.  hS    &  p.  S't).   Therefore, 
the  top-track  and  middle-track  groups  of  students  repre- 
sent independent  samples.   The  hypothesis  was  stated  as 
a  directional  hypothesis;  therefore  the  exact  proba- 
bilities will  not  be  divided  by  two. 
Statistical  Results 

Table  6 
Group  Means  and  t-ratios  For  Each  Independent  Sample 


Group 


Individual  ized 


Con  t  ro 


df 


Middle-Track 
Top-Track 


5^.00 
62.29 


61  .96 
62.15 


""■£ 

'-■•'•  Not  significant 

Conversion  to  Chi-square 


9^ 
35 


5.92^ 
0.06^ 


Note.  The  hypothesis  was  tested  at  £  <.05 
001 


Tabl e  7 
Conversion  to  Chi-square  of  Each  Independent  Sample 


Group 


Exac  t  Probability 


)C 


Mi  dd I e-Track    5.92 
Top-Track       0.06 


.001 

•  90(1 -. 90)  =  .  1 0 


3.B155 


Tota 


1  8.A207 


Note.   p  =  .90  was  subtracted  from  1  because  the  exper- 
i  men  ta I  group  mean  was  greater  than  the  control  group 
mean  (refer  to  Table  6). 
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H  i  rsch  (  ] 972) 


Background  Data 

Hirsch  compared  the  effects  of  guided  discovery  and 
individualized  instruction  on  several  outcome  measures. 
The  duration  of  the  study  was  one  semester.   The  subjects 
were  tenth-grade  Algebra  2  students.   The  schools  were 
located  in  Cedar  Rapids  and  Iowa  City,  Iowa. 
Characteristics  of  Individualization 

Individualization  was  characterized  by  the  use  of 
learning  activity  packages  and  progression  through  the 
material  at  each  student's  own  rate  (p.  60). 
Experimental  and  Control  Groups 

Three  intact  groups  of  students  were  assigned  three 
treatments.   The  three  treatments  were  specified  as  guided 
discovery,  instructional  packages  (expository  format), 
and  instructional  packages  (programmed  format). 

The  treatments  specified  as  instructional  packages 
were  each  individualized  as  defined  above.   The  instruc- 
tional package  treatments  differed  "only  with  respect  to 
programming  style"  (p.  6A).   Self-pacing  was  a  key  char- 
acteristic of  both  instructional  package  treatments.  Self- 
pacing  was  not  a  characteristic  of  the  guided  discovery 
treatment . 
Hypothesi  s 

Hirsch  developed  four  hypotheses  each  one  of  which 
corresponded  to  a  single  outcome  measure.   An  assumption 
was  made  that  the  outcome  measures  of  initial  learning  and 
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retention  were  sub-measures  of  academic  achievement. 
According  to  Hirsch,  initial  learning  "was  specifically 
designed  for  this  study  ...  to  provide  a  measure  of  stu- 
dent achievement"  (p.  67). 

Hirsch  designed  the  "Retention  Test  ...  to  provide 
a  measure  of  student  retention  of  complex  number  concepts" 
(pp.  71-72).   Many  educators  would  agree  that  "initial 
learning"  and  "retention"  are  measures  of  academic  achieve- 
ment. 

Conversely,  for  the  purpose  of  this  study,  it  was  not 
assumed  that  "lateral  transfer"  and  "vertical  transfer" 
were  measures  of  academic  achievement. 

Therefore,  only  hypotheses  "1"  and  "IV"  are  referred 

to  in  the  section  Statistical  Results  and  which  are  quoted 

in  the  folio  vjing  text. 

Hypothesis  1:   There  are  no  significant 
differences  among  the  adjusted  group 
initial  learning  means  for  the  three 
treatments. 

Hypothesis  IV:   There  are  no  significant 
differences  among  the  adjusted  group  re- 
tention means  for  the  three  treatments, 
(p.  83) 

Statistical  Results 


Hirsch  used  the  IF-test  to  compare  the  three  treatment 
group's  by  the  group's  respective  means.   Table  8  shows  the 
comparative  mean  scores  and  Table  9  shows  the  obtained  values 
of  F  for  the  two  outcome  measures  used  in  the  aggregate 
chi-square  statistic. 
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Table  8 

Adjusted  Mean  Scores 
for  Three  Treatment  Groups  and  Two  Outcome  Measures 


Trea  tment 


Initial     Learning  Retention 


Guided    Discovery  17.87 

Instructional    Packages    (expository)  15.75 

Instructional    Packages    (programmed)  15.78 


9.06 
7.92 
8.09 


No  t e  .   Guided  Discovery  wa  s  t  he  control  (traditional) 
group  and  Instructional  Package  groups  were  the  exper' 
imental  (individualized). 


Table  9 
F-ratios  for  Each  Independent  Sample 


Ou  t come  Measure 


df 


Initial  Learning 
Re  t  en  t  ion 


2/208 
2/208 


9.  19 
2.76 


<.  01 
<.05 


Note.   Both  F-ratios  favored  t  he  con  t  ro 1  (refer  to  Tab  1 


Conversion  to  Chi-square 

The  outcome  measures  initial  learning  and  retention 
were  considered  to  be  independent  samples.   The  conversion 
to  chi-square  of  the  £- ratio  for  each  outcome  measure  is 
as  foil ows . 
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Tabl e  1 0 
Conversion  to  Chi-square  of  Each  Independent  Sample 


Out  come  Measure 


Exact  Probability 


Initial  Learning     9-19 
Re  ten t  ion  2.76 


0005/2  =  .00025      12.0238 
0250/2  =  .0125        8.7657 


Total    20.7895 


Note.   The  exact  probabil  ities  were  divided  by  2  because 
the  hypothesis  was  non -d i  rec t i ona 1  . 

Hirsch  tested  for  post-hoc  comparisons  among  means 
and  found  a  significant  difference  between  the  control  and 
each  experimental  adjusted  group  mean.   No  significant 
difference  was  found  between  the  two  experimental  group 
means  and  thus  the  reported  F^- ratio  reflects  the  differ- 
ence between  the  control  and  experimental  groups. 

Ludeman  (1973) 
Background  Data 

Ludeman  investigated  the  effects  of  an  individualized 
program  on  ninth-grade  algebra  and  basic  mathematics  stu- 
dents.  The  investigation  was  carried  out  at  the  Arnold, 
Nebraska,  public  schools.   The  investigation  took  place  over 
the  course  of  one  school  year. 
Characteristics  of  Individualization 

Individualization  was  based  on  a  video-tape  program 
and  continuous  progress  format.    Individualized  student- 
tea  che  r-  pa  re  n  t  contracts  were  developed  and  were  the  basis 
of  a  self-paced  schedule  (p.  16). 
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Experimental  and  Control  Groups 

In  both  the  Basic  Mathematics  and  Algebra  1  classes, 
the  experimental  groups  were  those  that  received  individ- 
ualized mathematics  and  algebra  instruction  supplemented 
by  video-taped  presentations. 

The  control  group  was  the  previous  year's  ninth-grade 
class.   Ludeman  explained  that  this  was  due  to  the  fact 
that  Arnold  Public  Schools  were  a  small  rural  district. 
Consequently,  there  were  not  enough  students  to  form  an 
experimental  and  control  group  from  among  the  current 
enrollment  of  n i n t h -g rad e r s .   The  previous  year's  ninth- 
grade  class  had  not  received  the  individualized  instruc- 
tional program, 
Hypothes  i  s 

There  were  no  written  hypotheses  for  Lude man's  pro- 
ject.  An  objective  was  established  which  was  to  increase 
achievement  levels  by  5-10  percentile  points  (p.  1),  but 
an  hypothesis  was  not  generated  or  if  it  was  it  was  not 
in  the  reported  material. 
Statistical  Results 

For  Basic  Mathematics,  Ludeman  reported  a  control  group 
mean  of  -1.667  and  an  experimental  group  mean  of  2.333. 

The  results  yielded  _^(22)  =  I.58O,  £  >.05.   While  the 
t-ratio  was  not  significant  the  mean  scores  did  favor  the 
experimental . 

For  Algebra  1   (after  20  weeks  of  instruction),  Ludeman 
reported  a  control  group  mean  of  26.90  and  an  experimental 
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group  mean  of  30.50.   The  statistic  generated  from  those 
means  was  _^(29)  =  I.858,  £>.05.   Again,  the  _t^-ratio  was 
not  significant,  but  the  mean  scores  favored  the  exper- 
imental group. 
Conversion  to  Chi-square 


Tab] e  II 
Conversion  to  Chi-square  of  Each  Independent  Sample 


Group 


1-p 


r 


Basic  Mathematics     I.58O 
Algebra  1  1.858 


1  -.20  =  .80 

1  -.  I  0  =  .90 


kke3 
21  07 


Total       .6570 


Note  .   The  exact  one-tailed  probabilities  were  subtracted 
from  one  ( 1 -£)  as  per  Procedures  section  of  Chapter  I. 

An  assumption  was  made  that  Ludeman,  in  calculating 
the  t-ratio,  used  the  one-tailed  distribution  of  t_.       As 
was  stated  earlier,  Ludeman  reported  no  written  hypothe- 
sis.  However,  when  the  original  data  which  he  did  report 
(^(22)  =  1.580,£  >.05  5  _^(29)  =  1.858,p  >.05)  were  compared 
with  the  critical  values  which  he  also  reported  (2.07'<  & 
2.0^5,  respectively),  the  conclusion  was  reached  that 
Ludeman  had  worked  from  the  assumption  of  a  one-tailed 
hypothesis. 

Penner  (1972) 
Background  Data 

Penner  studied  the  effect  of  individualization  on 
achievement  in  trigonometry.   The  subjects  used  in  the  study 


53 
were  seniors  in  the  public  schools  of  Omaha,  Nebraska. 
The  study  was  conducted  during  the  first  semester. 
Characteristics  of  Individualization 

Penner  used  the  term  "individual  progress  approach" 
(p.  h)     and  stated  that  this  meant  an  approach  "which  al- 
lowed the  students,  with  the  aid  of  a  syllabus,  to  progress 
at  their  own  rates"  (p.  h) , 
Experimental  and  Control  Groups 

There  were  five  experimental  classes  (individualized) 
and  five  control  classes.   Five  schools  participated  in 
the  study  with  a  total  of  212  students.   Each  participating 
teacher  taught  one  experimental  and  one  control  class.   The 
students  in  the  experimental  groups  progressed  at  their 
own  rates  while  the  students  in  the  control  groups  were 
taught  in  a  traditional  manner. 
Hypothes  i  s 

Penner  stated  the  hypothesis  in  the  following  manner. 

There  is  no  significant  difference  in  stu- 
dent achievement  in  t r i gonome n t r y  between 
those  students  who  use  the  individual  pro- 
gress approach  and  those  who  use  the  tra- 
ditional approach.   (p.  5) 

Statistical  Results 


Penner  used  each  of  five  schools  (Benson,  Burke, 
Central,  North,  and  South)  as  independent  samples.   Table 
12  shows  the  reported  results. 
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Table  12 
Group  Means  and  t-scores  for  Each  Independent  Sample 


Sc  hoo I 


Experimental 


Control 


Benson 

Burke 

Centra 

North 

South 


18, 
20, 
25. 
13. 
15. 


826 
36A 
21  1 
538 
235 


17. 
20, 
21  , 
16, 
25. 


903 
1  92 

588 
080 
158 


5'45 
098 
073 
^09 
331 


Conversion  to  Chi-square 

TabI  e  1  3 
Conversion  to  Chi-square  of  Each  Independent  Sample 


Schoo 


t 


Exact  One-tailed  Probability 


Benson 

- 

.5^5 

Burke 

- 

.098 

Central 

-2 

.073 

North 

1 

'<09 

South 

h 

.331 

(.60/2)  = 

.  7000 

.7133 

(.90/2)  = 

.5500 

1  .  1957 

(.05/2)  = 

.9750 

.  0506 

.175/2   = 

.0875 

^4.8723 

.001/2   = 

.0005 

6.9078 

Tota 


13.7397 


Note.   The  exact  probabilities  were  subtracted  from  1 
because  the  group  means  for  those  schools  (Benson,  Burke, 
&  Central)  favored  the  experimental. 

Schoen  and  Todd  (197^) 


iackground  Data 

Schoen  and  Todd  investigated  two  questions. 

(a)  Does  the  detailed  preparation  of  a  con- 
cept centered  individualized  learning  pack- 
age (ILP)  by  a  teacher  improve  the  teacher's 
ability  to  teach  that  concept  using  either 

a  teacher  centered  (TC)  approach  or  a  learn- 
ing package  approach  (as  measured  by  student 
a  c  h  i  e vemen  t  )  ? 

(b)  Is  there  a  difference  in  student  achieve- 
ment scores  on  concept  taught  by  ILP  as  com- 
pared to  a  TC  approach?  (p.  2) 
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The  results  of  tlie  investigation  of  the  second 
question  "b"  are  the  results  reported  on  in  this  study. 
Characteristics  of  Individualization 

The  characteristics  of  individualization  included  the 
use  of  behavioral  objectives,  self-testing  on  pretests  and 
posttests,  learning  activity  packages,  and  individual  pro- 
gress through  the  learning  activity  packages  (p.  3). 
Experimental  and  Control  Groups 

Six  mathematics  teachers  were  paired  on  the  basis 
of  comparability  of  classes. 

Each  teacher  in  each  pair  had  two  classes 
of  mathematics  at  a  certain  level  and  his 
'mate'  had  two  classes  at  the  same  level. 
In  particualr,  each  teacher  in  pair  one 
taught  two  ninth  grade  General  Hat  hematics 
classes,  pair  two  taught  two  Algebra  1 
classes  and  the  third  pair  taught  eighth 
grade  General  Math  classes.   Thus,  six 
teachers  and  twelve  classes  were  involved 
in  the  experiment.   (p.  2) 

The  treatment  for  the  experimental  group  was  the  use 
of  ILP's  and  the  control  group  teachers  used  a  "lecture- 
discussion"  (p.  3)  methodology. 
Hypothes  i  s 

Schoen  and  Todd  did  not  write  out  their  hypothesis  in 
a  standard  way.   However,  from  the  following  quote,  the 
hypothesis  can  be  discerned.   "The  hypotheses  of  no  differ- 
ences in  achievement  scores  on  the  main  effects-TC  vs.  ILP 
and  preparer  vs.  non-preparer  could  not  be  rejected"  (p.  12) 
The  hypothesis  was  clearly  null  and  non -d i r ec t i ona 1   in 
nature. 
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Statistical  Results 


The  statistic  reported  by  Schoen  and  Todd  was  F^ 
(1/20)  =  .08  >.05.   Schoen  and  Todd  did  not  treat  each 
teacher  as  an  independent  sample.   Therefore,  the  statis- 
tical results  were  reported  by  Schoen  and  Todd  as  a 
composite  F_- ratio.   The  F^- ratio  was  taken  as  favoring  the 
control  groups  because,  when  the  group  means  were  com- 
pared for  eacli  teacher  (Table  I'*),  the  control  groups  had 
higher  scores. 

Table  U 
Group  Means  for  Schoen  and  Todd 


Teacher 


Experimenta 


Con  t  ro 


Unit  1 

Un  i  t  2 

Unit  1 

Un  i  t  2 

Unit  1 

Un  i  t  2 

Unit  1 

Uni  t  2 

Unit  1 

Unit  2 

Unit  I 

Unit  2 


1.1 
8. if 

7. A 
7.5 

13.2 

13.3 
15.2 

1  9.0 
3't.5 

15.0 
28.7 


9.5 
8.7 

6.9 


I  2.') 
11.2 

15.7 
15.2 

21.0 
3^.5 

11.1 
31  .1 


fJote.   Six  of  the  group  means  favored  the  control  and  four 
favored  the  experimental  while  two  were  identical. 

Conversion  to  Chi-square 

£(1/20)  =  .08 

p  =  .99/2  =  .'*95 


k^^k 


57 

The  probability  for  £(l/20)  =  .08  was  not  recorded 
in  a  standard  table.   Therefore,  the  conservative  proba- 
bility of  .99  was  used. 

Taylor  (1971) 
Background  Data 

Taylor  conducted  the  study  at  Crestmoor  High  School 
in  San  Bruno,  California.   The  duration  of  the  study  was 
one  semester.   The  subjects  were  ninth,  tenth,  and  eleventh 
graders  who  were  studying  Algebra  1. 
Characteristics  of  Individualization 

Independent  study  was  defined  to  be  a  learning  situa- 
tion in  which  the  students  studied  alone  or  in  small  groups 
with  a  minimum  amount  of  help  from  the  teacher.   The  stu- 
dents used  a  conventional  textbook  and  progressed  indi- 
vidually by  completing  assignments  and  tests  associated 
with  a  given  chapter  before  continuing  to  the  succeeding 
chapter.   "The  students  progress  at  their  own  rate  through 
a  specified  course  of  study"  (p.  10). 
Experimental  and  Control  Groups 

There  were  h8    students  used  as  subjects  in  the  study. 
The  students  were  enrolled  in  two  classes  of  Algebra  1. 
Twenty-five  students  were  in  the  individualized  class  and 
23  were  in  the  lecture-discussion  class.   The  experimenter 
taught  both  classes.   Assignments  to  classes  were  made  by 
a  flip  of  a  coin. 
Hypothes  i  s 

Taylor  generated  a  non -d i r ec t i ona 1  null  hypothesis 
which  was  stated  as  follows.   "There  is  no  difference 
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between  lecture-discussion  and  independent  study  with 
respect  to  growth  in  achievement  in  Algebra  1"  (p.  13). 
Statistical  Results 

The  reported  results  showed  that  t_(22)  =  1.16^8,  £_ 
>.05.   The  result  favored  the  control  group  but  was  not 
significant.   The  control  group  mean  was  9.600  while  the 
experimental  group  mean  was  7.522, 
Conversion  to  Chi-square 

The  reported  results  showed  that  _^(22)  =  1. 16^+8. 
In  converting  the  t-ratio  to  an  exact  one-tailed  proba- 
bility, the  following  result  was  obtained. 
£  =  .25/2  =.125 

A  probability  of  .125,  when  taken  to  the  extended 
table  of  chi-square,  yielded  a  chi-square  of  A.I589. 

Thomas  (1971) 
Background  Data 

Thomas  studied  the  effects  of  individualization  on 
five  classes  of  Advanced  Algebra  students  in  two  high 
schools  of  the  Lincoln  Public  Schools  at  Lincoln,  Nebraska. 
The  research  covered  a  period  of  one  school  year. 
Characteristics  of  Individualization 

The  individualized  algebra  program  was  characterized 
by  the  use  of  learning  activity  packages  (LAP's)  and  self- 
pacing.   Thomas  specifically  describes  the  self-pacing 
feature  as  "an  opportunity  for  each  student  to  proceed  at 
his  own  rate  of  speed,  commensurate  with  ability,  interest, 
and  motivation"  (p.  5). 


59 
Experimental  and  Control  Groups 

The  experimental  group  was  divided  into  five  classes 
with  a  total  of  102  students.   Two  teachers  were  assigned 
to  teach  the  five  classes  of  continuous  progress  mathematics 
(experimental  group).   The  five  classes  of  traditional 
advanced  algebra  were  taught  by  three  different  teachers. 
There  were  122  students  enrolled  in  the  traditional  classes. 
Hypothes  i  s 

Thomas  stated  the  hypothesis  in  the  null  form  and 
as  non- d i r ec t i ona 1  in  the  following  manner.   "There  is  no 
significant  difference  between  the  achievement  posttest 
mean  of  the  continuous  progress  advanced  algebra  classes 
and  the  achievement  posttest  mean  of  the  traditional  ad- 
vanced algebra  classes"  (p.  6). 
Statistical  Results 

The  results  were  reported  as  not  being  significant. 
However,  the  reported  group  means  indicated  that  the  exper- 
imental group  achieved  more  than  the  control  group.   The 
experimental  group  mean  was  29.91  and  the  control  group 
mean  was  28.35. 

The  derived  statistic  was  £(1/1^9)  =  .203,  £>.05. 
Conversion  to  Chi-square 

Fd/i'jg)  =  .203 
P  =  .99 
Reversed  p  =  l-(.99/2)  =  .505 
)P=  1  .366'^ 

The  probability  for  F_(l/1'*9)  =  .203  was  not  recorded 

in  a  standard  table.   Therefore,  the  conservative  probability 

of  .99  was  used. 
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Computation  of  the  Aggregate  Chi-square 
Table  )5  shows  the  individual  chi-square  statistics 
and  the  aggregate  chi-square  statistic.   By  pooling  the 
individual  research  results,  this  researcher  was  able  to 
use  the  data  from  the  studies  previously  reported  as  not 
significant.   This  feature  of  the  aggregate  chi-square  was 
very  important  in  that  8  of  the  11  original  studies  were 
reported  as  not  significant.   By  pooling  the  previously 
reported  non - s i g n i f i ca n t  studies  into  the  aggregate  chi- 
square,  the  non - s i g n i f i ca n t  studies  added  data  that  pro- 
duced a  highly  significant  result- 
Table  15 
The  Aggregate  Chi-square  Statistic 


Experimenter 


Nr.  of  Independent  Samples     Total  of  X' 


Bui  1   (1971  ) 
Englert  (1972) 
Fisher  (1973) 
Ha  nnema  n  (1971) 
Herceg  (1972) 
Hi  rsch  ( 1 972) 
Ludeman  (1973) 
Penner  (1972) 
Schoen  &  Todd  ( 
Taylor  (1971) 
Thomas  (1971) 


97^* 


5. 0201 

9.8536 

3.2189 

23.3568 

1  8.^*207 

20. 7895 

.6570 

1  3.7397 

1  .  ^4  0  6 '( 

A.  1 589 

1 .366^ 


Aggregate  Chi-square  IOI.988O 

Note.   Aggregate  x^^fB)  =  IOI.988O,  p_    <.001. 

The  df  (48)  results  from  multiplying  2  times  n.     (the  number 
of  independent  samples),  (Gordon,  Loveland,  &  Cureton,  1952, 
p.  3U). 

The  probability  .001  had  to  be  adjusted  to  be  consis- 
tent with  the  underlying  assumption  that  the  results  could 
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be  in  either  direction  (whicii  requires  a  two-tailed  test). 
Each  independent  statistical  result  used  to  achieve  a  com- 
bined statement  of  significance  was  generated  from  one- 
tailed  probabilities.   Even  when  the  original  researcher 
used  a  two-tailed  test,  the  result  had  to  be  converted  to 
a  one-tailed  probability  (as  per  procedures). 

The  problem  (and  therefore  the  reason  why  the  pro- 
bability of  the  aggregate  chi-square  statistic  has  to  be 
adjusted)  came  because  of  the  fact  that  the  aggregate  chi- 
square  procedure  allowed  for  a  result  in  either  direction. 
When  the  procedure  allows  for  a  result  in  either  direction, 
a  two-tailed  probability  is  required. 

"The  tabled  significance  value  must  therefore  be 
doubled"  (Gordon   et  al.,  1952,  p.  315)  in  order  to  avoid 
the  contradiction  of  the  one-tailed  result  (using  one- 
tailed  probabilities  in  the  aggregate  chi-square)  with  the 
two-tailed  assumption  (willingness  to  consider  a  result  in 
either  direction).   The  probability,  then,  is  .002  and  not 
.001  . 


S  umma  r y 
The  aggregate  chi-square  statistic  for  the  2k     inde- 
pendent research  samples  of  self-paced  individualized 
instruction  showed  that  self-paced  individualized  instruc- 
tional practices  were  not  superior  to  traditional  instruc- 
tional practices.    In  fact,  the  reverse  could  be  implied; 
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that  is,  traditional  instructional  practices  were  superior 
to  self-paced  individualized  instructional  practices.   The 
probability  of  .002  for  this  combined  significance  test 
indicated  that  in  998  of  every  1,000  cases  this  result 
would  be  replicated.   In  other  words,  it  was  very  unlikely 
that  this  result  came  by  chance. 


CHAPTER  IV 

SUMMARY,  CONCLUSIONS,  IMPLICATIONS, 
AND  SUGGESTIONS  FOR  FURTHER  RESEARCH 


Summa  r y 

The  problem  of  this  study  was  to  determine  the  effec- 
tiveness of  self-paced  individualized  instruction  by 
applying  the  aggregate  chi-square  statistical  procedure 
to  the  results  of  several,  previously  done,  independent 
studies  which  have  analyzed  self-paced  individualized 
instruction  in  its  relationship  to  student  achievement. 
What  would  be  the  result  when  these  several   independent 
results  were  pooled  to  derive  a  single  statistic? 

The  accountability  movement  and  a  philosophical/ 
emotional  commitment  of  professional  educators  have  exerted 
considerable  force  on  local  school  administrators  to  adopt 
individualization  as  the  dominant  (if  not  only)  instruc- 
tional strategy.   This  pressure  has  been  very  forceful  in 
spite  of  the  fact  that  empirical  research  has  not  supported 
the  claims  made  for  individualized  instruction.   Empirical 
research  studies  done  on  individualized  instruction  have 
presented  an  inconsistent  and  therefore  an  indicisive 
pattern  of  results.   The  aggregate  chi-square  procedure  was 
applied  to  the  results  of  a  set  of  11  previously  reported 
studies  in  an  attempt  to  discern  a  consistent  pattern. 
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6^4 
The  strength  of  the  aggregate  chi-square  procedure 
lies  in  the  use  that  was  made  of  non - s i g n i f i can t  data. 
Schoen  (1976)  reported  on  the  results  of  12  independent 
researchers.   Of  the  11  studies  included  from  Schoen's 
review  in  this  study,  8  of  the  researchers  reported  non- 
significant results.   Unless  some  secondary  analysis  was 
done,  the  review  was  not  very  enlightening  or  helpful  in 
educational  decision  mal<ing  that  was  concerned  with  self- 
paced  individualized  instruction. 

However,  when  the  results  of  the  8  non - s i g n i f i ca n t 
studies  were  able  to  be  included   in  a  statistical  procedure 
such  as  the  aggregate  chi-square,  a  completely  new  and  much 
stronger  picture  was  obtained.   This  result  was  consistent 
with  the  kinds  of  results  that  Gage  (Note  1)  obtained  when 
applying  the  aggregate  chi-square  procedure  to  sets  of  in- 
dependent studies  which  had  been  previously  done  on  several 
teacher  variables.   Instead  of  a  capricious  and  inconsistent 
picture,  a  clear  indication  of  the  strength  of  the  vari- 
ables on  the  outcomes  measured  was  clearly  evident.   Speci- 
fically, in  this  study,  the  result  was  aggregate  X  ( '^  8 )  = 
101.9880,  £<.002.   Ttiis  result  indicated  that  self-paced 
individualized  instructional  practices  were  not  superior 
to  traditional  instructional  practices.    In  fact,  the  reverse 
could  be  implied;  that  is,  tradi  tiona  I  instructional  practices 
were  superior  to  self-paced  individualized  instructional 
practices.   The  probability  of  .002  for  this  combined  sig- 
nificance test  indicated  that  in  998  of  every  1,000  cases 
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this  result  would  be  replicated.    In  other  words,  it 
was  very  unlikely  that  this  result  came  about  by  chance 

Conclusions 


The  results  of  this  study  indicated  that  traditional 
classroom  instructional  practices  were  superior  to  indi- 
vidualized (self-paced)  instructional  practices.   In  evalu- 
ating this  conclusion,  it  should  be  recognized  that  the 
procedure  used  in  this  study  did  not  take  into  account  the 
relative  merit  of  the  individual  research  studies  in  terms 
of  design,  interaction  effects  within  studies  and  a  host 
of  other  technical  considerations.   The  basic  assumption 
was  that  the  independent  statistical  results  generated  by 
each  researcher  were  adequate  statistical  statements  of 
the  strength  of  self-paced  individualized  instruction  as 
measured  by  that  study. 


Impl  ications 
There  were  two  important  implications  derived  from 
this  study.   One  implication  was  in  the  area  of  research 
techniques.   The  emphasis  that  Gage  (Note  1),  Glass  (1976) 
and  Light  and  Smith  (1971)  have  placed  on  secondary  anal- 
ysis of  educational  research  seemed  completely  justified. 
The  weak  and  vascilating  research  results  often  reported 
in  educational  research  reviews  have  not  been  a  true  account 
of  the  status  of  educational  practices.   This  study  support- 
ed  the  notion  that  what  is  done  in  classrooms  is  important 
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and  does  effect  a  student  outcome  such  as  achievement. 
The  viability  of  the  aggregate  chi-square  as  a  tool  for 
secondary  analysis  was  also  supported. 

A  second  implication  was  in  the  area  of  decision 
making  regarding  educational  programs  and  practices. 
Educational  leaders  have  been  susceptible  to  the  political, 
philosophical,  and  social  forces  which  constantly  impinge 
on  the  life  of  the  schools.   Accountability  has  been  a 
force  that  has  vitally  affected  the  programs  in  the  schools 
(Darland,  1970;  Davies,  1970;  Lessinger,  1971;  Morris,  1971; 
Sciara  &  Jantz,  1972). 

Educational  leaders  have  been  pressed  to  defend  their 
programs  and  practices  with  measureable  results  (Dunkin  £ 
Biddle,  197^;  Lessinger,  1971).   More  specifically,  they 
have  been  pressed  to  defend  their  programs  and  practices 
with  measureable  results  focused  on  the  achievement  of 
individual  students  (Davies,  1970;  Morris,  1971).   The 
practice  of  self-paced  individualized  instruction  was  a 
logical  response  to  the  demand  for  measureable  results.  The 
progress  of  individual  students  was  thought  to  be  a  more 
precise  gauge  of  success  in  the  classroom  than  group  norms 
produced  by  standardized  norm  referenced  tests. 

The  program  of  self-paced  individualized  instruction 
was  also  a  logical  response  to  another  force  that  was 
beginning  to  make  a  strong  impact  on  the  educational  commu- 
nity.  As  Davies  (1970)  and  MOrfis  (1971)  indicated,  there 
was  a  need  to  find  an  educational  vehicle  through  which 
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and  by  which  the  maximum  potential  of  the  individual 
student  could  be  realized.   Self-paced  individualized 
instruction  seemed  to  offer  the  solution  to  the  problem 
of  accountability  and  to  the  need  for  individualized 
plans  of  instruction. 

It  appeared  that  there  had  been  a  happy  marriage  of 
the  "commitments"  to  accountability  which  would  be  measured 
by  individual  student  performance  and  the  commitment  to  the 
development  of  "individual  human  beings"  (Davies,  1970, 
p.  129).   Self-paced  individualized  instruction  provided 
a  common  ground  for  these  two  commitments  and  practicing 
educators  have  felt  the  persistent  weight  of  the  force 
generated  by  these  two  commitments. 

The  results  of  this  study  indicated  that  self-paced 
individualized  instruction  was  not  the  t eac h i ng / 1 ea rn i ng 
strategy  that  would  satisfy  the  demands  of  the  accounta- 
bility  movement  nor  was  it  able  to  meet  the  idealistic 
demands  of  developing  every  individual  to  his  fullest 
potential  (at  least  not  academic  potential).   Perhaps  some 
other  form  of  individualized  instruction  could  meet  those 
demands  and  herein  lies  a  hint  at  one  direction  further 
research  on  the  topic  of  individualized  instruction  might 
take. 


Suggestions  for  Further  Research 
In  this  study,  self-paced  individualized  instruction 
was  investigated.    It  might  be  very  helpful   if  some 
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empirical  research  studies  were  done  in  which  self-paced 
and  t ea che r -  paced  individualized  instruction  were  com- 
pared.  The  following  comments  will  serve  to  strenghten 
this  point  and  also  serve  to  clarify  what  is  meant  by 
"teacher-paced.'.' 

Taveggia  (1976)  reviewed  ] k    separate  studies  each  of 
which  compared  the  "learning  outcomes  of  a  new  instruc- 
tional procedure,  the  'Personalized  System  of  Instruction' 
(PSI),  with  the  learning  outcomes  of  conventional  approaches 
to  college  teaching"  (p.  1028).   Taveggia  made  a  potentially 
significant  observation  when  he  pointed  out  that  "five 
features  probably  account  for  the  superiority  of  PSI  over 
conventional  methods"  (p.  IO30).   The  Personalized  System 
of  Instruction  was  superior  to  conventional  methods  of 
college  instruction  in  all  \h     studies  reported  in  Taveggia's 
review. 

The  significant  point  made  by  Taveggia  was  that  the 
feature  termed  "go- a t -  you r -own  -  pace"  (p.  IO3O)  was  one  of 
five  features  that  seemed  to  make  the  PSI  appraoch  better 
than  conventional  approaches.  Also,  that  the  term  go-at- 
your-own-pace  was  a  misnomer.  "A  more  appropriate  desig- 
nation would  be  monitored  pacing  or  forced  pacing"  (p.  IO3O) 
The  following  excerpt  presents  a  more  complete  picture  of 
the  forced  pacing  concept  of  the  PSI  approach. 

A  second,  less  obvious  option  suggested 
by  the  explanation  developed  above  for  the 
superiority  of  PSI  is  to  reorganize  one's 
conventional  courses,  "building  in"  the 
unit-perfection,  forced-pacing,  and  moni- 
tored progression  features  of  PSI.   The 


69 

available  evidence  suggests  that  these 
probably  are  the  features  which  account 
for  the  superiority  of  PS!  over  conven- 
tional methods.   Thus,  to  the  degree  that 
these  features  are  incorporated  into  con- 
ventional courses,  student  mastery  of 
course  content  material  probably  will  be 
enhanced.   (Taveggia,  1976,  p.  IO3I) 

The  concepts  of  un i  t - pe r f ec t i on  ,  f o r ced - pac i ng ,  and 
monitored  progression  mentioned  above,  do  indeed  point  to 
a  definite  forcing  of  the  pace  which  is  in  direct  contrast 
to  the  concept  of  self-pacing. 

There  does  seem  to  be  a  significant  relationship  be- 
tween what  kind  of  "pacing"  is  used  and  the  strength  of  an 
individualized  methodology  in  terms  of  that  methodology's 
ability  to  change  student  outcomes.   V/hile  it  was  recog- 
nized that  the  studies  reviewed  by  Taveggia  were  at  the 
college  level,  the  results  may  have  important  implications 
for  individualized  instructional  techniques  at  all  levels 
and  may  be  revealing  as  to  why  self-paced  individualized 
instruction  did  not  fare  well  when  submitted  to  the  aggre- 
gate chi-square  procedure.   In  the  future,  when  studies  of 
individualized  instruction  are  conducted,  there  should  be 
an  effort  to  more  clearly  define  the  "pacing"  function  and 
to  attempt  to  establish  its  direct  relationship  to  student 
ou  tconies  . 


APPEND  I  X 

HISTORY  OF  AGGREGATE  CHI-SQUARE 
AND  TRANSFORMATION  PROCEDURES 


The  aggregate  chi-square  procedure  was  developed  by 
Fisher  {^Sk8).       The  aggregate  chi-square  procedure  was 
based  upon  tfie  fact  that  the  distribution  of  the  sum  of 
several  values  of  chi-square  was  itself  distributed  as  a 
chi-square  for  two  degrees  of  freedom  was  -2  times  the 
natural  logarithm  of  the  probability  (pp.  99"10I). 

Wiiile  other  researchers  have  discussed  the  technique 
and  its  possible  applications  (Lancaster,  IS'^S  &  Wa  1  1  i  s  , 
\S^2),     there  have  been  few  attempts  to  use  the  aggregate 
chi-square  method  in  published  research  studies.   Perhaps 
the  reason  for  the  few  applications  of  the  aggregate  chi- 
square  has  been  due  to  the  fact  that  an  extended  table  of 
values  for  chi-square  with  two  degrees  of  freedom  was  not 
available  until  1952.    It  was  in  1952  that  Gordon   et  al. 
developed  the  extended  table  which  could  be  used  in  com- 
bining probabilities  from  independent  samples.   However, 
it  has  to  be  noted  that  there  were  no  published  studies 
known  to  this  researcher  using  the  aggregate  chi-square 
even  after  the  Gordon   et  al.   (1952)  extended  table  was 
published.   There  v;as,  of  course,  one  exception  to  the 
previous  assertion  and  that  exception  was  Gage  (1977). 
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The  chi-square  model  was  based  on  the  proof  that 
any  £  value  could  be  transformed  to  a  chi-square  value 
with  two  degrees  of  freedom  and  that  the  sum  of  indepen- 
dent chi-squares  was  distributed  as  a  chi-square.   Follov 
ing  is  an  outline  of  the  transformation  procedure  as 
developed  by  Fisher  (19^8,  p().  99-101). 


1.   The  transformation  equation: 


X  =  -2  log^  p 


1) 


2.  Composite  X   's  given  by  the  formula; 

2      k 
X  =  -2.Z  log   p.  (2) 

1  =  1    ^   ' 

3.  Degrees  of  freedom: 

2k_  degrees  of  freedom  where  k  is  the 
number  of  independent  probability  values 
to  be  combined. 

4.  Joint  probability  of  k_  independent  results: 

The  product  of  the  k_  separate  £  values. 
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